-- Logs begin at Thu 2022-07-28 00:20:18 UTC, end at Thu 2022-07-28 01:32:41 UTC. -- Jul 28 01:04:13.474111 dv-cinder-815582-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 01:04:13.485612 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 01:04:13 2022] *** Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: nodename: dv-cinder-815582-11-iscsi Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: machine: x86_64 Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: clock source: unix Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: pcre jit disabled Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: detected number of CPU cores: 4 Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: current working directory: / Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: detected binary path: /usr/bin/uwsgi-core Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: your processes number limit is 47680 Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: your memory page size is 4096 bytes Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: detected max file descriptor number: 2048 Jul 28 01:04:13.487409 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: lock engine: pthread robust mutexes Jul 28 01:04:13.488230 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: thunder lock: enabled Jul 28 01:04:13.488230 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 01:04:13.488230 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 01:04:13.531123 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: Python main interpreter initialized at 0x56341385d9c0 Jul 28 01:04:13.531123 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: python threads support enabled Jul 28 01:04:13.531123 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: your server socket listen backlog is limited to 100 connections Jul 28 01:04:13.531123 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: your mercy for graceful operations on workers is 90 seconds Jul 28 01:04:13.531512 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 01:04:13.531512 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: *** Operational MODE: preforking *** Jul 28 01:04:13.531794 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: *** uWSGI is running in multiple interpreter mode *** Jul 28 01:04:13.531794 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: spawned uWSGI master process (pid: 103378) Jul 28 01:04:13.532014 dv-cinder-815582-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 01:04:13.532531 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: spawned uWSGI worker 1 (pid: 103379, cores: 1) Jul 28 01:04:13.532863 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: spawned uWSGI worker 2 (pid: 103380, cores: 1) Jul 28 01:04:13.533018 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 01:04:14.187921 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 01:04:14.188563 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 01:04:15.256275 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:04:15.256275 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: from cryptography.utils import int_from_bytes Jul 28 01:04:15.257032 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:04:15.257032 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: from cryptography.utils import int_from_bytes Jul 28 01:04:15.262158 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:04:15.262158 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: from cryptography.utils import int_from_bytes Jul 28 01:04:15.262689 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:04:15.262689 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: from cryptography.utils import int_from_bytes Jul 28 01:04:17.750267 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 01:04:17.750919 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 01:04:17.751048 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 01:04:17.751360 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 01:04:17.751618 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 01:04:17.751988 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 01:04:17.752429 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.752562 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 01:04:17.752702 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.752702 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.752943 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 01:04:17.753117 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.753266 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 01:04:17.753393 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.753519 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 01:04:17.753645 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.753781 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.753906 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.754043 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.754172 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.754312 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.754438 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.755045 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.755181 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.755312 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.755420 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.755618 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.755770 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-11-iscsi {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.755931 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.756070 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.756244 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.756385 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.756568 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.756719 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.756871 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.757009 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.757109 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.757223 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.757441 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-11-iscsi {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.757600 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.757747 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.757885 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.758045 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.758259 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.758725 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.758725 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.759116 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.759291 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.759467 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.759636 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.759813 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.759980 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.760152 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.760152 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.760447 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.760610 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.760744 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.760882 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761008 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761146 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761282 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761433 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761681 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761819 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761960 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.761960 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.762272 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-11-iscsi {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.762402 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.762584 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.762762 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.762913 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.763099 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.763227 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.763380 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.763521 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.763673 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-11-iscsi {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.763814 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.763948 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.764122 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.764272 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.764414 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.764601 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.764731 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.764916 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.765103 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.765260 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.765387 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.765731 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.765870 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.766004 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.766225 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.766353 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.766491 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.766634 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.766814 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767025 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767156 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767297 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767415 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767542 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767668 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767797 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.767922 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768039 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768159 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768159 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768400 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768533 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768663 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768783 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768909 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.768909 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.769140 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.769284 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.769408 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.769536 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.769654 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.769654 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.769909 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.770036 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.770161 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.770284 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.770410 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.770528 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.770667 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.770667 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771011 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771131 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771274 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771423 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771541 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771659 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771842 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.771961 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.772082 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.772217 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.772335 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.772453 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.772572 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.772713 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.772878 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773053 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773172 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773290 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773410 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773538 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773673 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773800 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.773995 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.774167 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.774380 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.774517 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.774657 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.774776 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.774944 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.775070 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.775271 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.775439 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.775589 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.775909 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.776034 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.776165 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.776292 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.776410 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.776545 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.776677 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.776860 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777029 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777149 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777282 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777408 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777544 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777668 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777792 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.777946 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.778082 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.778277 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.778450 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.778450 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.778701 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.778896 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779046 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779164 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779298 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779417 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779537 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779663 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779795 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.779914 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.780035 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.780240 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.780401 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.780556 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.780678 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.780800 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.780929 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.781097 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.781226 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.781357 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.781482 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.781676 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.781851 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782042 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782175 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782314 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782444 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782563 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782684 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782802 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.782985 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.783129 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.783260 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.783379 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.783497 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.783689 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.783865 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.784009 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.784132 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.784261 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.784393 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.784511 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.784646 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.784837 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.785017 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.785145 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.785269 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.785403 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.785522 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.785656 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.785776 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.786052 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.786173 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.786299 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.786423 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.786558 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.786690 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.786809 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787050 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787230 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787357 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787492 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787612 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787731 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787848 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.787986 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.788114 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.788240 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.788358 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.788591 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.788797 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.788933 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.789077 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.789205 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.789417 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.789578 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.789722 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.789854 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.789993 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.790123 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.790243 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.790429 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.790601 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.790740 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.790983 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.791107 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.791231 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.791349 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.791476 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.791609 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.791730 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.791868 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.792043 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.792230 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.792351 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.792492 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.792649 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.792775 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.792970 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.793143 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.793280 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.793455 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.793584 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.793788 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.793950 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.794084 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.794215 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.794367 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:04:17.794559 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.794720 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795021 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795166 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795302 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795422 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795547 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795670 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795813 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.795943 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.796103 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.796227 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.796413 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.796536 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.796724 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.796854 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.797062 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.797221 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.797349 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.797473 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.797666 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.797851 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.797991 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.798116 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.798265 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.798408 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.798594 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.798735 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.798924 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.799065 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.799266 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.799439 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.799571 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.799727 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.799863 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.799987 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.800117 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.800238 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.800454 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.800633 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.800762 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.800889 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.801027 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.801146 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.801341 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.801478 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.801644 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.801776 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.801976 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.802108 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.802319 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.802482 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.802617 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.802749 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.802939 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.803075 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.803241 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.803360 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.803543 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.803672 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.803847 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.803983 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.804226 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.804350 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.804543 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.804674 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.804856 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.804987 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.805168 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.805303 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.805478 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.805600 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.805789 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.805919 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.806187 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.806324 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.806549 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.806677 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.806879 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.806983 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.807193 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.807339 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.807525 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.807652 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.807831 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.807966 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.808145 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.808449 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.808565 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.808763 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.808907 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.809043 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.809163 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.809349 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.809471 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.809650 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.809781 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.809950 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.810070 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.810248 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.810369 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.810544 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.810664 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.810896 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.811019 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.811209 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.811331 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.811518 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.811657 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.811841 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.811969 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.812140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.812261 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.812451 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.812591 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.812753 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.812874 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.813060 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.813179 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.813360 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.813568 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.813689 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.813819 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.813939 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.814071 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.814246 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.814392 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.814550 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.814672 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.814889 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.815015 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.815197 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.815327 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.815506 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.815637 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.815814 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.815936 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.816120 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.816241 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.816435 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.816572 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.816747 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.816872 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.817062 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.817194 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.817360 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.817482 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.817667 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.817812 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.817985 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.818106 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.818297 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.818430 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.818608 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.818746 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.818969 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.819093 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.819303 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.819438 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.819607 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.819750 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.819964 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.820095 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.820278 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.820409 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.820590 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.820721 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.820892 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.821013 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.821200 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.821320 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.821496 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.821636 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.821795 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.821919 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.822088 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.822218 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.822383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.822505 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.822685 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.822819 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.823008 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.823156 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.823287 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.823405 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.823588 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.823712 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.823884 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.824015 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.824181 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.824303 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.824478 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.824608 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.824782 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.824902 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.825083 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.825222 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.825380 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.825520 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.825675 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.825808 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.825971 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.826103 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.826303 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.826432 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.826605 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.826748 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.826967 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.827100 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.827302 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.827392 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.827613 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.827726 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.827936 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.828073 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.828238 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.828360 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.828549 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.828687 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.828854 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.828985 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.829160 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.829282 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.829465 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.829587 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.829770 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.829902 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.830086 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.830216 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.830392 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.830518 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.830701 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.830860 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.831028 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.831166 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.831345 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.831465 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.831647 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.831768 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.831956 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.832075 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.832253 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.832385 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.832561 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.832679 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.832895 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.833022 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.833199 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.833328 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.833511 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.833634 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.833820 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.833952 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.834124 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.834246 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.834428 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.834547 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.834728 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.834899 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.835055 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.835178 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.835424 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.835550 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.835732 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.835869 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.836049 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.836147 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.836351 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.836453 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.836667 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.836767 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.836973 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.837121 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.837299 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.837420 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.837603 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.837745 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.837909 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.838090 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.838219 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.838339 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.838503 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.838623 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.838828 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.839002 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.839174 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.839296 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.839478 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.839611 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.839781 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.839903 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.840088 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.840208 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.840391 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.840522 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.840693 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.840811 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.840980 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.841114 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.841274 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.841395 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.841570 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.841691 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.841872 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.842080 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.842201 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.842322 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.842446 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.842567 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.842754 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.842988 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.843113 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.843244 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.843362 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.843500 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.843659 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.843794 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.843965 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.844088 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.844253 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.844373 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.844557 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.844690 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.844873 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.844992 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.845174 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.845294 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.845479 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.845600 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.845783 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.845904 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.846078 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.846198 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.846375 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.846497 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.846696 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.846898 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.847021 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.847142 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.847286 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.847433 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.847563 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.847684 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.847867 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.848007 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.848197 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.848314 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.848501 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.848618 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.848798 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.848935 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.849107 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.849223 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.849419 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.849534 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.849720 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.849848 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.850027 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.850141 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.850326 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.850441 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.850629 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.850773 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.851030 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.851208 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.851345 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.851462 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.851623 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.851766 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.851921 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.852043 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.852221 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.852341 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.852522 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.852681 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.852825 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.852946 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.853143 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.853283 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.853439 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.853563 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.853742 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.853874 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.854044 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.854164 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.854336 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.854507 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.854671 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.854959 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.855100 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.855292 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.855523 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.855657 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.855851 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.855971 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.856158 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.856291 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.856469 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.856591 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.856782 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.856901 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.857104 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.857302 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.857442 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.857577 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.857731 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.857865 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.858043 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.858168 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.858350 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.858511 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.858648 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.858767 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.858948 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.859073 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.859251 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.859387 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.859549 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.859670 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.859843 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.859965 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.860141 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.860274 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.860436 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.860559 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.860736 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.860871 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.861029 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.861163 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.861331 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.861457 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.861624 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.861747 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.861921 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.862059 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.862227 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.862348 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.862522 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.862643 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.862825 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.862996 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.863127 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.863294 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.863444 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.863582 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.863747 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.863876 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.864044 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.864166 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.864341 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.864463 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.864641 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.864787 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.864972 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.865106 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.865268 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.865390 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.865598 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.865720 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.865910 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.866044 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.866220 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.866358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.866565 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.866687 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.866889 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.867012 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.867197 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.867338 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.867499 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.867622 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.867799 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.867937 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.868100 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.868275 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.868406 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.868529 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.868760 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.868900 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869039 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869157 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869279 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869403 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869556 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869692 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869859 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.869994 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.870157 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.870289 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.870450 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.870581 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.870757 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.870986 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.871122 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.871245 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.871426 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.871570 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.871704 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.871842 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.871962 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.872083 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.872204 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.872344 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.872503 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.872626 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.872806 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.872928 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.873106 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.873269 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.873411 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.873530 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.873684 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.873806 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.873995 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.874129 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.874291 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.874411 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.874588 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.874710 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.874917 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.875057 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.875203 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.875336 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.875504 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.875627 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.875798 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.875931 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.876102 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.876248 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.876413 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.876543 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.876713 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.876894 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.877016 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.877138 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.877311 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.877431 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.877568 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.877686 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.877891 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.878011 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.878192 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.878311 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.878493 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.878613 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.878951 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.879082 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.879208 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.879330 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.879474 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.879606 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.880081 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.880203 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.880323 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.880456 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.880612 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.880736 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.880912 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.881043 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.881207 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.881346 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.881504 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.881632 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.881796 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.881927 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.882090 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.882278 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.882454 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.882587 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.882757 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.882911 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.883084 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.883222 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.883383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.883504 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.883679 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.883802 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.883973 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.884096 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.884306 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.884429 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.884600 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.884723 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.884944 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.885073 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.885238 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.885364 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.885546 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.885668 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.885852 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.885971 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.886155 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.886277 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.886453 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.886584 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.886757 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.886904 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.887102 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.887226 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.887393 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.887536 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.887690 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.887811 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.887988 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.888111 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.888283 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.888415 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.888578 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.888700 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.888893 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.889032 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.889206 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.889326 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.889516 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.889648 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.889822 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.889954 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.890122 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.890261 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.890437 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.890562 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.890734 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.890993 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.891138 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.891259 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.891381 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.891503 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.891678 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.891799 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.891936 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.892066 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.892201 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.892333 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.892507 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.892630 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.892811 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.892942 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.893113 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.893237 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.893414 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.893533 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.893740 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.893859 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.893981 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.894103 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.894288 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.894423 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.894588 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.894720 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.894907 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.895032 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.895227 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.895372 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.895526 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.895646 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.895823 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.895945 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.896124 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.896260 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.896422 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.896548 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.896720 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.896840 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.897017 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.897156 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.897449 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.897619 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.897749 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.897900 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.898074 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.898270 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.898395 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.898677 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.898797 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.899063 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.899286 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.899459 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.899743 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.899863 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.900067 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.900215 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.900378 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.900687 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.900807 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.900989 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.901111 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.901291 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.901479 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.901602 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.901792 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.901937 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.902096 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.902220 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.902405 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.902547 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.902706 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.902828 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.903028 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.903169 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.903323 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.903445 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.903643 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.903765 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.903943 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.904078 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.904242 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.904391 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.904531 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.904696 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.904832 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.905110 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.905231 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.905424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.905550 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.905733 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.905867 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.906056 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.906177 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.906378 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.906499 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.906697 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.906862 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.907033 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.907153 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.907348 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.907471 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.907663 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.907820 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.907974 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.908118 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.908292 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.908424 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.908601 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.908736 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.908916 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.909057 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.909218 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.909340 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.909540 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.909684 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.909850 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.909986 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.910154 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.910278 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.910461 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.910587 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.910760 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.910925 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.911100 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.911224 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.911416 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.911548 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.911722 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.911846 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.912039 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.912164 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.912406 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.912528 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.912712 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.912846 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.913025 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.913146 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.913331 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.913513 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.913740 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.913863 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.914045 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.914169 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.914347 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.914490 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.914655 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.914779 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.914988 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.915112 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.915290 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.915479 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.915609 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.915730 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.915881 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.916002 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.916186 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.916324 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.916503 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.916637 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.916792 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.916913 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.917095 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.917236 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.917394 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.917526 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.917711 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.917891 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.918023 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.918148 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.918306 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.918429 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.918610 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.918732 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.918937 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.919061 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.919243 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.919366 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.919543 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.919729 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.919865 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.919987 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.920144 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.920267 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.920441 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.920563 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.920737 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.920862 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.921032 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.921154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.921365 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.921506 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.921663 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.921786 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.921981 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.922125 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.922300 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.922448 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.922618 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.922740 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.922967 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.923109 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.923274 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.923408 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.923581 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.923704 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.923891 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.924033 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.924194 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.924329 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.924496 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.924626 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.924797 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.924918 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.925103 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.925225 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.925403 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.925537 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.925704 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.925827 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.925997 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.926118 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.926294 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.926417 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.926598 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.926721 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.926934 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.927058 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.927281 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.927404 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.927528 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.927652 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.927794 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.927970 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.928092 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.928227 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.928370 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.928506 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.928672 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.928805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.928972 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.929120 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.929296 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.929430 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.929593 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.929715 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.929927 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.930053 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.930224 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.930360 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.930550 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.930692 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.930884 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.931014 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.931203 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.931338 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.931516 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.931638 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.931819 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.931941 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.932137 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.932287 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.932444 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.932568 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.932754 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.932876 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.933084 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.933244 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.933366 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.933494 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.933657 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.933780 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.933968 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.934102 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.934279 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.934535 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.934659 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.934897 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.935045 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.935205 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.935327 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.935516 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.935648 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.935829 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.936065 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.936187 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.936391 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.936512 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.936702 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.936850 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.937011 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.937145 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.937324 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.937446 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.937631 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.937767 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.937937 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.938113 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.938243 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.938368 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.938533 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.938670 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.938876 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.939031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.939170 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.939348 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.939483 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.939662 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.939784 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.939967 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.940090 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.940274 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.940409 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.940636 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.940762 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.940949 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.941073 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.941255 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.941378 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.941567 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.941690 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.941879 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.942016 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.942189 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.942361 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.942482 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.942619 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.942783 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.942943 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.943115 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.943237 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.943420 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.943543 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.943723 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.943862 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.944027 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.944150 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.944334 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.944455 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.944703 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.944843 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.945020 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.945143 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.945331 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.945453 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.945639 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.945769 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.945947 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.946074 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.946256 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.946397 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.946567 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.946689 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.946901 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.947131 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.947255 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.947450 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.947595 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.947785 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.947909 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.948114 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.948308 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.948444 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.948617 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.948741 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.948945 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.949068 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.949264 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.949401 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.949582 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.949713 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.949890 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.950011 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.950203 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.950345 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.950520 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.950643 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.950820 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.951023 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.951149 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.951286 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.951417 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.951540 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.951726 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.951865 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.952020 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.952154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.952341 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.952511 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.952633 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.952863 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.952997 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.953208 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.953332 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.953515 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.953636 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.953841 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.954036 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.954157 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.954379 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.954503 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.954690 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.954823 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.955034 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.955158 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.955353 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.955477 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.955665 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.955801 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.955969 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.956100 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.956272 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.956404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.956570 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.956704 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.956869 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.956991 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.957176 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.957307 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.957479 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.957618 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.957774 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.957896 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.958072 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.958194 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.958377 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.958520 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.958673 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.958795 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.958996 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.959118 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.959299 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.959422 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.959594 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.959728 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.959899 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.960020 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.960203 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.960359 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.960529 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.960649 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.960824 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.960945 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.961122 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.961243 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.961414 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.961536 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.961710 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.961842 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962048 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962178 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962302 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962437 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962561 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962713 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962862 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.962992 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.963172 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.963294 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.963467 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.963602 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.963768 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.963891 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.964063 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.964186 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.964364 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.964499 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.964704 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.964825 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.965015 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.965138 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.965307 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.965449 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.965601 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.965726 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.965904 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.966027 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.966209 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.966336 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.966519 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.966641 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.966820 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.967091 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.967231 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.967425 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.967551 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.967743 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.967866 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.968073 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.968279 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.968414 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.968608 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.968743 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.968920 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.969053 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.969247 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.969370 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.969572 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.969694 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.969874 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.970008 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.970175 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.970300 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.970474 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.970601 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.970781 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.970948 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.971121 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.971219 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.971420 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.971518 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.971721 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.971825 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.972028 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.972160 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.972323 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.972445 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.972630 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.972776 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.972927 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.973050 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.973230 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.973354 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.973530 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.973653 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.973830 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.973953 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.974131 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.974264 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.974431 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.974565 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.974729 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.974876 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.975072 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.975217 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.975379 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.975502 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.975698 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.975820 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.976064 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.976200 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.976375 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.976502 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.976680 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.976861 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.977000 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.977130 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.977283 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.977406 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.977587 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.977720 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.977889 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.978031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.978192 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.978315 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.978504 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.978646 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.978822 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.979024 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.979155 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.979278 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.979434 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.979565 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.979832 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.979954 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.980140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.980261 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.980457 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.980598 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.980739 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.980858 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.981050 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.981175 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.981355 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.981489 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.981667 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.981800 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.981971 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.982094 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.982283 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.982416 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.982585 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.982719 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.982982 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.983251 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.983376 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.983599 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.983723 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.983911 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.984034 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.984206 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.984339 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.984504 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.984627 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.984800 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.984934 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.985100 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.985234 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.985407 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.985528 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.985706 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.985828 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.986003 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.986142 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.986302 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.986432 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.986598 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.986729 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.986911 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.987056 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.987222 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.987345 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.987496 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.987628 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.987791 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.987912 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.988091 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.988218 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.988383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.988504 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.988681 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.988820 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.988972 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.989094 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.989264 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.989387 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.989558 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.989682 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.989852 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.989975 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.990152 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.990283 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.990492 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.990658 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.990791 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.990954 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.991074 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.991213 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.991333 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.991461 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.991620 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.991751 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.991930 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.992064 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.992254 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.992378 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.992563 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.992698 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.992881 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.993035 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.993183 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.993306 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.993496 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.993618 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.993797 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.993919 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.994111 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.994233 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.994424 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.994545 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.994729 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.994895 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.995055 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.995179 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.995383 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.995516 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.995682 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.995803 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.995984 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.996106 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.996288 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.996426 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.996594 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.996722 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.996893 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.997027 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.997199 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.997335 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.997517 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.997638 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.997831 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.997953 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.998130 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.998263 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.998445 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.998567 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.998759 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.998962 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.999100 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.999239 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.999384 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.999508 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.999688 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:17.999810 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.000001 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.000132 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.000350 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.000479 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.000599 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.000785 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.000918 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.001040 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.001167 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.001289 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.001473 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.001605 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.001780 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.001903 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.002082 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.002214 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.002384 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.002519 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.002695 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.002817 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.003024 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.003186 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.003342 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.003482 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.003806 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.003977 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.004140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.004300 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.004420 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.004557 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005033 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005155 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005279 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005405 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005529 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005664 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005867 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.005990 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.006178 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.006299 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.006434 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 01:04:18.006564 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.006773 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.007101 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:04:18.007407 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 01:04:18.162922 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Registered counter for database nova_api Jul 28 01:04:18.163820 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO dbcounter [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Registered counter for database nova_api Jul 28 01:04:18.183784 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.186138 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.190616 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.193062 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writer thread running {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.246556 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.context [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7726ad62-7e36-457c-b9d8-9bde6568cf65(cell1) {{(pid=103380) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 01:04:18.249732 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.context [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7726ad62-7e36-457c-b9d8-9bde6568cf65(cell1) {{(pid=103379) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 01:04:18.250643 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:04:18.252194 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:04:18.252975 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:04:18.253742 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:04:18.255293 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:04:18.255774 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:04:18.256577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:04:18.257335 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Registered counter for database nova_cell0 Jul 28 01:04:18.258572 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:04:18.260640 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO dbcounter [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Registered counter for database nova_cell0 Jul 28 01:04:18.263377 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Registered counter for database nova_cell1 Jul 28 01:04:18.266385 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO dbcounter [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Registered counter for database nova_cell1 Jul 28 01:04:18.273244 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.274069 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.275357 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.279966 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.280314 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.283368 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.286990 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writer thread running {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.428164 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Registered counter for database nova_cell0 Jul 28 01:04:18.434521 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writer thread running {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.438434 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.444798 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.447741 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO dbcounter [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Registered counter for database nova_cell0 Jul 28 01:04:18.456200 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:04:18.462817 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writer thread running {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:04:18.789018 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:04:18.790539 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: WARNING keystonemiddleware.auth_token [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:04:18.796553 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:04:18.797861 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: WARNING keystonemiddleware.auth_token [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:04:19.144711 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:04:19.145701 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: WARNING keystonemiddleware.auth_token [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:04:19.152477 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: WARNING keystonemiddleware.auth_token [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:04:19.158069 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56341385d9c0 pid: 103379 (default app) Jul 28 01:04:19.158401 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-174dbbc6-fc61-48b3-a079-58327fd16ab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:04:19.160284 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:04:19.161479 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001821 Jul 28 01:04:19.161885 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Thu Jul 28 01:04:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:04:19.163860 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56341385d9c0 pid: 103380 (default app) Jul 28 01:05:36.325101 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:36.326154 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 28 01:05:36.326540 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:05:36.349786 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=3 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:36.350980 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_cell0:SELECT=3 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:36.352096 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_cell1:SELECT=3 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:36.353783 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:37.321482 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-626e6e2a-81d5-42fe-89a7-a602dfcd1d71 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:37.356227 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-626e6e2a-81d5-42fe-89a7-a602dfcd1d71 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.019398 Jul 28 01:05:37.364746 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jul 28 01:05:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:05:39.643060 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:39.644852 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-c6d716fa-ed03-42a8-9be7-096f167d7168 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002530 Jul 28 01:05:39.651423 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:39 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:05:40.151840 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-a407a638-e90a-4440-a16b-8f4c71e25f1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:40.172843 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:05:40.172843 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: warnings.warn(msg) Jul 28 01:05:40.204273 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-a407a638-e90a-4440-a16b-8f4c71e25f1b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.549839 Jul 28 01:05:40.205155 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:05:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:05:40.218703 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_api:SELECT=3 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:40.220010 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_cell0:SELECT=3 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:40.221072 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_cell1:SELECT=3 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:40.221896 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:05:40.423855 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-464ed8c6-9442-4133-a5e8-a16575e1064e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:40.428258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:05:40.428258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: warnings.warn(msg) Jul 28 01:05:40.498336 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-464ed8c6-9442-4133-a5e8-a16575e1064e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284775 Jul 28 01:05:40.511607 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jul 28 01:05:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:05:42.784729 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-a407a638-e90a-4440-a16b-8f4c71e25f1b admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:42.786901 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-a407a638-e90a-4440-a16b-8f4c71e25f1b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002486 Jul 28 01:05:42.787638 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:05:43.636120 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-3d92ab8e-1f13-459f-9969-6a5f494ea54c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "disk": 5, "vcpus": 1}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:43.655040 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:05:43.655040 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: warnings.warn(msg) Jul 28 01:05:43.676871 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-3d92ab8e-1f13-459f-9969-6a5f494ea54c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.881200 Jul 28 01:05:43.677833 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:05:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:05:43.691185 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9438faaa-dda6-4b7c-9943-f3adcc601fe7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:43.694997 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:05:43.694997 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: warnings.warn(msg) Jul 28 01:05:43.732598 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9438faaa-dda6-4b7c-9943-f3adcc601fe7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045428 Jul 28 01:05:43.733442 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jul 28 01:05:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:05:45.963200 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-3d92ab8e-1f13-459f-9969-6a5f494ea54c admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:45.964218 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-3d92ab8e-1f13-459f-9969-6a5f494ea54c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jul 28 01:05:45.964613 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:05:46.386319 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-4fe6cb44-937d-4e5f-b657-cdbb454d0628 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:46.408074 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-4fe6cb44-937d-4e5f-b657-cdbb454d0628 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437245 Jul 28 01:05:46.408670 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:05:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:05:46.420762 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-44c2782e-bd3c-43dc-a7db-d81472a01c19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:46.446215 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-44c2782e-bd3c-43dc-a7db-d81472a01c19 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029143 Jul 28 01:05:46.447122 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jul 28 01:05:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:05:48.691433 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-4fe6cb44-937d-4e5f-b657-cdbb454d0628 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:48.692470 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-4fe6cb44-937d-4e5f-b657-cdbb454d0628 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Jul 28 01:05:48.693045 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:05:49.177559 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-22614175-32ae-49ca-8e57-f5c82d0fe131 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "id": "d3"}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:49.214088 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-22614175-32ae-49ca-8e57-f5c82d0fe131 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514390 Jul 28 01:05:49.215288 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:05:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:05:49.228769 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-7ee2c621-79f9-4da2-a211-9aba0b03dd60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:49.254354 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-7ee2c621-79f9-4da2-a211-9aba0b03dd60 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030322 Jul 28 01:05:49.255344 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jul 28 01:05:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:05:51.510427 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-22614175-32ae-49ca-8e57-f5c82d0fe131 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:51.511561 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-22614175-32ae-49ca-8e57-f5c82d0fe131 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 28 01:05:51.511914 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:05:51.941337 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-4cf076f4-72d4-49cb-823a-ac3611f89e9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:51.968737 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-4cf076f4-72d4-49cb-823a-ac3611f89e9a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450435 Jul 28 01:05:51.969317 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:05:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:05:51.984858 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-08370c49-af93-4ad5-8140-6b7b8abd69bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:52.014747 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-08370c49-af93-4ad5-8140-6b7b8abd69bc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035569 Jul 28 01:05:52.015531 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jul 28 01:05:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:05:54.262651 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-4cf076f4-72d4-49cb-823a-ac3611f89e9a admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:54.264296 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-4cf076f4-72d4-49cb-823a-ac3611f89e9a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002291 Jul 28 01:05:54.264920 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:05:54.707349 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-cf980b7e-ae26-4e30-acb5-c00ea81a3cee admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:54.732218 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-cf980b7e-ae26-4e30-acb5-c00ea81a3cee admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460274 Jul 28 01:05:54.732753 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jul 28 01:05:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:05:57.047246 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-4cf076f4-72d4-49cb-823a-ac3611f89e9a admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:57.048406 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-4cf076f4-72d4-49cb-823a-ac3611f89e9a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jul 28 01:05:57.048819 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:05:57.493378 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-8e22b6d1-c2ef-449c-b030-686533261004 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:57.516255 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-8e22b6d1-c2ef-449c-b030-686533261004 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460637 Jul 28 01:05:57.516866 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:05:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 01:05:57.530717 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-a2f511c7-ec46-4d67-add5-e7423c158081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:05:57.560349 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-a2f511c7-ec46-4d67-add5-e7423c158081 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033335 Jul 28 01:05:57.561608 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jul 28 01:05:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:05:59.833490 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-8e22b6d1-c2ef-449c-b030-686533261004 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:05:59.834511 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-8e22b6d1-c2ef-449c-b030-686533261004 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 28 01:05:59.835001 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:00.244616 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-641dcf25-32a6-457a-baf2-babac52f2254 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:00.266335 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-641dcf25-32a6-457a-baf2-babac52f2254 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424231 Jul 28 01:06:00.266937 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:05:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:06:00.279852 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-d4f6484b-8a90-4d60-bcaf-d78d5a629bb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:00.305210 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-d4f6484b-8a90-4d60-bcaf-d78d5a629bb3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029947 Jul 28 01:06:00.305875 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jul 28 01:06:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:06:02.500904 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-641dcf25-32a6-457a-baf2-babac52f2254 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:02.501917 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-641dcf25-32a6-457a-baf2-babac52f2254 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 28 01:06:02.502346 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:02.871689 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-3a88be2a-fd02-4f0b-a646-7754d8c33964 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "swap": 0, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:02.896391 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-3a88be2a-fd02-4f0b-a646-7754d8c33964 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.387514 Jul 28 01:06:02.896939 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:06:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 01:06:02.908828 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-33891019-c101-487f-9775-4b207f65994d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:02.935525 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-33891019-c101-487f-9775-4b207f65994d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030081 Jul 28 01:06:02.936201 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jul 28 01:06:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:06:05.158179 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-3a88be2a-fd02-4f0b-a646-7754d8c33964 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:05.159258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-3a88be2a-fd02-4f0b-a646-7754d8c33964 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 28 01:06:05.159641 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:05.678538 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e8547a60-f536-41a2-934c-40fe7e611cb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "vcpus": 4, "id": "4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:05.701002 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e8547a60-f536-41a2-934c-40fe7e611cb5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.535138 Jul 28 01:06:05.701565 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:06:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:06:05.714251 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-281a50f9-b464-4303-b281-b646c492684e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:05.744033 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-281a50f9-b464-4303-b281-b646c492684e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033641 Jul 28 01:06:05.744948 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jul 28 01:06:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:06:08.027428 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e8547a60-f536-41a2-934c-40fe7e611cb5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:08.028516 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e8547a60-f536-41a2-934c-40fe7e611cb5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 28 01:06:08.029212 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:08.515211 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-4c2d1fb2-71a3-4e2c-9964-304e6c131af3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "swap": 0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:08.537182 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-4c2d1fb2-71a3-4e2c-9964-304e6c131af3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.501646 Jul 28 01:06:08.537733 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jul 28 01:06:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:06:08.549975 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-c4ddeb67-aa9e-4088-b9ca-c71ebc850973 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:08.556946 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:06:08.580122 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-c4ddeb67-aa9e-4088-b9ca-c71ebc850973 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033838 Jul 28 01:06:08.581029 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jul 28 01:06:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:06:30.199395 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-4c2d1fb2-71a3-4e2c-9964-304e6c131af3 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:30.201080 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-4c2d1fb2-71a3-4e2c-9964-304e6c131af3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002573 Jul 28 01:06:30.201802 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:30.215141 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:06:30.692542 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-d6ff6ed9-17c3-4b36-b1f9-5b1917e0489a admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:30.711976 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-d6ff6ed9-17c3-4b36-b1f9-5b1917e0489a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.501671 Jul 28 01:06:30.712522 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jul 28 01:06:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:06:31.886651 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-4c2d1fb2-71a3-4e2c-9964-304e6c131af3 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:31.888495 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-4c2d1fb2-71a3-4e2c-9964-304e6c131af3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002575 Jul 28 01:06:31.889231 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:32.568904 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-6343c4cf-1c94-4c91-a6fb-11ee75f8bd43 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:32.575542 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.wsgi [None req-6343c4cf-1c94-4c91-a6fb-11ee75f8bd43 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-6343c4cf-1c94-4c91-a6fb-11ee75f8bd43 admin admin] Request method failure captured: Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Accept: application/json Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Accept-Encoding: gzip, deflate Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Connection: keep-alive Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Content-Length: 0 Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Host: 10.222.0.17 Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Openstack-Api-Version: compute 2.90 Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Openstack-System-Scope: None Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: User-Agent: python-novaclient Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Auth-Token: gAAAAABi4eEXfCWsBJB1j02OgULyjWZ2KM_2Bu_01X0U0ZQzhxHc67vc13L9iOxlPV_DZFl0BglwOT-iaWwk7UicQymHIoi2P2bNLe-yMCDtrdgoKks7cCrY3_wO4ydxbqTh7ph3_x55--iPrOlozzRDvgj_EsrXKVH1vtGzQPBs5Rpf8VatsY8 Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Domain-Id: None Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Domain-Name: None Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Identity-Status: Confirmed Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Is-Admin-Project: True Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Domain-Id: default Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Domain-Name: Default Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Name: admin Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Role: reader,admin,member Jul 28 01:06:32.579914 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Roles: reader,admin,member Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb3fd2235b214e75887726b6b079e208", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant: admin Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant-Name: admin Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User: admin Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Domain-Id: default Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Domain-Name: Default Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Id: 52c6f46685584e8380771f008e5f1d77 Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Name: admin Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: method: > Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: exception: Flavor 42 could not be found. Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: action_args: {'id': '42'} Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:06:32.582805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:32.584424 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.586635 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-6343c4cf-1c94-4c91-a6fb-11ee75f8bd43 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:06:32.588692 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-6343c4cf-1c94-4c91-a6fb-11ee75f8bd43 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.555505 Jul 28 01:06:32.588692 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jul 28 01:06:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 557 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 01:06:32.594036 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-150a7ac2-87ec-441c-a909-fd69d2acda1c admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:32.598661 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:06:32.619740 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-150a7ac2-87ec-441c-a909-fd69d2acda1c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029281 Jul 28 01:06:32.620315 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jul 28 01:06:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:06:32.634899 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-3e64fe24-1f21-4cfa-b84a-f5a1363f5fa7 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:32.680613 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-3e64fe24-1f21-4cfa-b84a-f5a1363f5fa7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.052146 Jul 28 01:06:32.681872 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jul 28 01:06:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:06:32.692384 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-820ac6b9-eb3e-42a0-8f7e-d4bad7b8d2a9 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:32.699657 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.wsgi [None req-820ac6b9-eb3e-42a0-8f7e-d4bad7b8d2a9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-820ac6b9-eb3e-42a0-8f7e-d4bad7b8d2a9 admin admin] Request method failure captured: Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Accept: application/json Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Accept-Encoding: gzip, deflate Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Connection: keep-alive Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Content-Length: 0 Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Host: 10.222.0.17 Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Openstack-Api-Version: compute 2.90 Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Openstack-System-Scope: None Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: User-Agent: python-novaclient Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Auth-Token: gAAAAABi4eEXfCWsBJB1j02OgULyjWZ2KM_2Bu_01X0U0ZQzhxHc67vc13L9iOxlPV_DZFl0BglwOT-iaWwk7UicQymHIoi2P2bNLe-yMCDtrdgoKks7cCrY3_wO4ydxbqTh7ph3_x55--iPrOlozzRDvgj_EsrXKVH1vtGzQPBs5Rpf8VatsY8 Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Domain-Id: None Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Domain-Name: None Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Identity-Status: Confirmed Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Is-Admin-Project: True Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Domain-Id: default Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Domain-Name: Default Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Name: admin Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Role: reader,admin,member Jul 28 01:06:32.703140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Roles: reader,admin,member Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb3fd2235b214e75887726b6b079e208", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant: admin Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant-Name: admin Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User: admin Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Domain-Id: default Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Domain-Name: Default Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Id: 52c6f46685584e8380771f008e5f1d77 Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Name: admin Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: method: > Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: exception: Flavor 42 could not be found. Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: action_args: {'id': '42'} Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:06:32.705404 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:32.710271 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:32.712383 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-820ac6b9-eb3e-42a0-8f7e-d4bad7b8d2a9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:06:32.714149 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-820ac6b9-eb3e-42a0-8f7e-d4bad7b8d2a9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016736 Jul 28 01:06:32.714149 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jul 28 01:06:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 01:06:33.758286 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-3e64fe24-1f21-4cfa-b84a-f5a1363f5fa7 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:33.760680 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-3e64fe24-1f21-4cfa-b84a-f5a1363f5fa7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003338 Jul 28 01:06:33.761800 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:34.382162 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-74c965ea-b37e-4649-a32d-8a59b37fc156 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:34.390663 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.wsgi [None req-74c965ea-b37e-4649-a32d-8a59b37fc156 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-74c965ea-b37e-4649-a32d-8a59b37fc156 admin admin] Request method failure captured: Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Accept: application/json Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Accept-Encoding: gzip, deflate Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Connection: keep-alive Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Content-Length: 0 Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Host: 10.222.0.17 Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Openstack-Api-Version: compute 2.90 Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Openstack-System-Scope: None Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: User-Agent: python-novaclient Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Auth-Token: gAAAAABi4eEZRYyzRKjYlfXK7T__jqA6VFydSH3RbZXCuQ4IFnjmGtZBDKbas9dwZ3tCtnj9CK2YFZwWiD7fHtyTJER7FDvr3Ygtnw6mEUYA62UWGLpSjgzNaEYS941XtoXwLxRVsp9hi1clLKhpiCAipHaGNn8ARAzSjhIlPdrJ487BShyMdOQ Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Domain-Id: None Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Domain-Name: None Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Identity-Status: Confirmed Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Is-Admin-Project: True Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Domain-Id: default Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Domain-Name: Default Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Name: admin Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Role: reader,admin,member Jul 28 01:06:34.392292 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Roles: reader,admin,member Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb3fd2235b214e75887726b6b079e208", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant: admin Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant-Name: admin Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User: admin Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Domain-Id: default Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Domain-Name: Default Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Id: 52c6f46685584e8380771f008e5f1d77 Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Name: admin Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: method: > Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: exception: Flavor 84 could not be found. Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: action_args: {'id': '84'} Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:06:34.394173 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:34.395951 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.398358 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-74c965ea-b37e-4649-a32d-8a59b37fc156 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:06:34.400496 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-74c965ea-b37e-4649-a32d-8a59b37fc156 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.492807 Jul 28 01:06:34.400496 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jul 28 01:06:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 494 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 01:06:34.404283 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-60dbf9e7-9ff7-4b55-9f1e-ee36c2f9ff27 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:34.421162 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-60dbf9e7-9ff7-4b55-9f1e-ee36c2f9ff27 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020494 Jul 28 01:06:34.421726 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jul 28 01:06:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:06:34.435399 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-6f25a13d-0678-4f73-b628-e5d7d4e33391 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:34.463513 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-6f25a13d-0678-4f73-b628-e5d7d4e33391 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034395 Jul 28 01:06:34.464510 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jul 28 01:06:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:06:34.478680 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-1ed14110-37c5-489e-bf2a-6427cdac3f65 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:34.485199 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.wsgi [None req-1ed14110-37c5-489e-bf2a-6427cdac3f65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-1ed14110-37c5-489e-bf2a-6427cdac3f65 admin admin] Request method failure captured: Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Accept: application/json Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Accept-Encoding: gzip, deflate Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Connection: keep-alive Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Content-Length: 0 Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Host: 10.222.0.17 Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Openstack-Api-Version: compute 2.90 Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Openstack-System-Scope: None Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: User-Agent: python-novaclient Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Auth-Token: gAAAAABi4eEZRYyzRKjYlfXK7T__jqA6VFydSH3RbZXCuQ4IFnjmGtZBDKbas9dwZ3tCtnj9CK2YFZwWiD7fHtyTJER7FDvr3Ygtnw6mEUYA62UWGLpSjgzNaEYS941XtoXwLxRVsp9hi1clLKhpiCAipHaGNn8ARAzSjhIlPdrJ487BShyMdOQ Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Domain-Id: None Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Domain-Name: None Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Identity-Status: Confirmed Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Is-Admin-Project: True Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Domain-Id: default Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Domain-Name: Default Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Name: admin Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Role: reader,admin,member Jul 28 01:06:34.486755 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Roles: reader,admin,member Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb3fd2235b214e75887726b6b079e208", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant: admin Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant-Name: admin Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User: admin Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Domain-Id: default Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Domain-Name: Default Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Id: 52c6f46685584e8380771f008e5f1d77 Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Name: admin Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: method: > Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: exception: Flavor 84 could not be found. Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: action_args: {'id': '84'} Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:06:34.489031 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:34.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:34.492764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-1ed14110-37c5-489e-bf2a-6427cdac3f65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:06:34.494597 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-1ed14110-37c5-489e-bf2a-6427cdac3f65 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014305 Jul 28 01:06:34.494597 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jul 28 01:06:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 01:06:35.585948 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-6f25a13d-0678-4f73-b628-e5d7d4e33391 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:35.587520 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-6f25a13d-0678-4f73-b628-e5d7d4e33391 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jul 28 01:06:35.588121 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:36.225902 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-61efdb55-a573-47ff-823e-1a31bbe8c04b admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:36.232596 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.wsgi [None req-61efdb55-a573-47ff-823e-1a31bbe8c04b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-61efdb55-a573-47ff-823e-1a31bbe8c04b admin admin] Request method failure captured: Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Accept: application/json Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Accept-Encoding: gzip, deflate Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Connection: keep-alive Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Content-Length: 0 Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Host: 10.222.0.17 Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Openstack-Api-Version: compute 2.90 Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Openstack-System-Scope: None Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: User-Agent: python-novaclient Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Auth-Token: gAAAAABi4eEbF8FIGhA2sCgXKSMZQNtCdFjX6VQ88tBzSPYlxbPXgeqhqqF5Siu7VPyCco5tiOonGqdbUgbXWSOuyoiVHU8hfwJ8tvukqdwMKDY-MS_RPweEHt5ZhWDDSOPXmd_fPMPvudt6pzEeHQDGP5gu2tR_Ua-nVys5Qh4zYOCnoProzdc Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Domain-Id: None Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Domain-Name: None Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Identity-Status: Confirmed Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Is-Admin-Project: True Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Domain-Id: default Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Domain-Name: Default Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Project-Name: admin Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Role: reader,admin,member Jul 28 01:06:36.234154 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Roles: reader,admin,member Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb3fd2235b214e75887726b6b079e208", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant: admin Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-Tenant-Name: admin Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User: admin Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Domain-Id: default Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Domain-Name: Default Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Id: 52c6f46685584e8380771f008e5f1d77 Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: X-User-Name: admin Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: method: > Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: exception: Flavor 451 could not be found. Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: action_args: {'id': '451'} Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:06:36.236468 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:36.237847 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.239805 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-61efdb55-a573-47ff-823e-1a31bbe8c04b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:06:36.241823 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-61efdb55-a573-47ff-823e-1a31bbe8c04b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.493924 Jul 28 01:06:36.241823 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jul 28 01:06:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 495 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 01:06:36.248763 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-47ef2235-2137-4f1c-bb5a-23fb95fbc36b admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:36.265906 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-47ef2235-2137-4f1c-bb5a-23fb95fbc36b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020727 Jul 28 01:06:36.266500 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jul 28 01:06:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:06:36.277436 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:36.294388 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020584 Jul 28 01:06:36.294974 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jul 28 01:06:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:06:36.305728 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-36268c57-98b9-4845-a7ca-9aac0a42b398 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:36.312646 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.wsgi [None req-36268c57-98b9-4845-a7ca-9aac0a42b398 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-36268c57-98b9-4845-a7ca-9aac0a42b398 admin admin] Request method failure captured: Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Accept: application/json Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Accept-Encoding: gzip, deflate Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Connection: keep-alive Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Content-Length: 0 Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Host: 10.222.0.17 Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Openstack-Api-Version: compute 2.90 Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Openstack-System-Scope: None Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: User-Agent: python-novaclient Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Auth-Token: gAAAAABi4eEbF8FIGhA2sCgXKSMZQNtCdFjX6VQ88tBzSPYlxbPXgeqhqqF5Siu7VPyCco5tiOonGqdbUgbXWSOuyoiVHU8hfwJ8tvukqdwMKDY-MS_RPweEHt5ZhWDDSOPXmd_fPMPvudt6pzEeHQDGP5gu2tR_Ua-nVys5Qh4zYOCnoProzdc Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Domain-Id: None Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Domain-Name: None Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Identity-Status: Confirmed Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Is-Admin-Project: True Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Domain-Id: default Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Domain-Name: Default Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Project-Name: admin Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Role: reader,admin,member Jul 28 01:06:36.314258 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Roles: reader,admin,member Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb3fd2235b214e75887726b6b079e208", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb3fd2235b214e75887726b6b079e208"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant: admin Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant-Id: bb3fd2235b214e75887726b6b079e208 Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-Tenant-Name: admin Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User: admin Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Domain-Id: default Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Domain-Name: Default Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Id: 52c6f46685584e8380771f008e5f1d77 Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: X-User-Name: admin Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: method: > Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: exception: Flavor 451 could not be found. Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: action_args: {'id': '451'} Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:06:36.316577 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:36.318295 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: ERROR nova.api.openstack.wsgi Jul 28 01:06:36.320614 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-36268c57-98b9-4845-a7ca-9aac0a42b398 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:06:36.322887 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-36268c57-98b9-4845-a7ca-9aac0a42b398 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014721 Jul 28 01:06:36.322887 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jul 28 01:06:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 01:06:37.367854 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:37.368924 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jul 28 01:06:37.369351 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:38.032395 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-74de9813-f1b7-4b27-a08a-29797b0fccad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:38.058063 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-74de9813-f1b7-4b27-a08a-29797b0fccad admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.549272 Jul 28 01:06:38.058703 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jul 28 01:06:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 01:06:39.118201 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:39.119736 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Jul 28 01:06:39.120293 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:39.744967 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-c582b58b-bda1-4419-beae-a38209ac8da3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:39.768140 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-c582b58b-bda1-4419-beae-a38209ac8da3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.510404 Jul 28 01:06:39.768714 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jul 28 01:06:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 01:06:40.826972 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:40.828017 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jul 28 01:06:40.828435 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:41.607189 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-cdaa27ae-845b-4ded-baa4-b5998edda868 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:41.628855 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-cdaa27ae-845b-4ded-baa4-b5998edda868 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.544264 Jul 28 01:06:41.629408 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jul 28 01:06:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:06:42.981668 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:42.982784 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Jul 28 01:06:42.983249 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:43.639048 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-0cf88592-52dc-411a-84fa-63e6026d7654 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:06:43.660427 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-0cf88592-52dc-411a-84fa-63e6026d7654 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.537743 Jul 28 01:06:43.661003 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jul 28 01:06:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:06:44.746280 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:44.748247 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002696 Jul 28 01:06:44.748988 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:06:45.399255 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-7dc50c2c-caaa-4646-86e7-75ee7db0f3e6 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:06:45.424189 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-7dc50c2c-caaa-4646-86e7-75ee7db0f3e6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.530957 Jul 28 01:06:45.424757 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Thu Jul 28 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:07:42.215115 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:07:42.216014 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-9f5cb76b-3c8c-4bf3-b24e-28dd6f9b83c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jul 28 01:07:42.216467 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jul 28 01:07:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:07:42.228643 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:07:42.710613 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-6b875cbb-5f4c-495c-8ca0-d0f5cb5528f7 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:07:42.749761 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-6b875cbb-5f4c-495c-8ca0-d0f5cb5528f7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.525300 Jul 28 01:07:42.750665 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jul 28 01:07:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:07:42.772899 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=14 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:07:42.776764 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-dc3cf04d-7c72-4984-9a08-75807343c1bf admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:07:42.785195 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-dc3cf04d-7c72-4984-9a08-75807343c1bf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013876 Jul 28 01:07:42.785763 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Thu Jul 28 01:07:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:07:42.798824 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-d05a23d0-5930-4d00-b5ae-3219acdda45a admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:07:42.807853 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-d05a23d0-5930-4d00-b5ae-3219acdda45a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012614 Jul 28 01:07:42.808422 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Thu Jul 28 01:07:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:07:42.826112 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:07:42.835186 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012828 Jul 28 01:07:42.835850 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Thu Jul 28 01:07:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:07:42.848787 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-4d7f5ef6-c391-4274-81a0-9ebdef7606f7 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:07:42.858342 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-4d7f5ef6-c391-4274-81a0-9ebdef7606f7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013008 Jul 28 01:07:42.858993 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Thu Jul 28 01:07:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:11:26.789456 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:26.790483 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 28 01:11:26.790909 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:11:26.929897 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_api:SELECT=6 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:11:27.099037 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-11b422dd-8b64-4a65-ae34-aa51035d09f8 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:27.101496 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:11:27.101496 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: warnings.warn(msg) Jul 28 01:11:27.102785 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-11b422dd-8b64-4a65-ae34-aa51035d09f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:27.103262 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-11b422dd-8b64-4a65-ae34-aa51035d09f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:27.104068 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-11b422dd-8b64-4a65-ae34-aa51035d09f8 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:27.104495 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-11b422dd-8b64-4a65-ae34-aa51035d09f8 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:27.145224 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-11b422dd-8b64-4a65-ae34-aa51035d09f8 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.216609 Jul 28 01:11:27.145845 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jul 28 01:11:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 01:11:27.999136 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:28.000210 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jul 28 01:11:28.000606 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:11:28.214980 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-10af4a7d-4770-428e-8f8e-0cc2e9413217 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:28.219225 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:11:28.219225 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: warnings.warn(msg) Jul 28 01:11:28.221622 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-10af4a7d-4770-428e-8f8e-0cc2e9413217 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:28.222392 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-10af4a7d-4770-428e-8f8e-0cc2e9413217 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:28.223864 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-10af4a7d-4770-428e-8f8e-0cc2e9413217 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:28.224623 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-10af4a7d-4770-428e-8f8e-0cc2e9413217 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:28.253253 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-10af4a7d-4770-428e-8f8e-0cc2e9413217 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.109682 Jul 28 01:11:28.253948 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jul 28 01:11:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:11:39.548010 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:39.549030 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 28 01:11:39.549512 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:11:39.691827 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_cell0:SELECT=4 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:11:39.692552 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_cell1:SELECT=4 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:11:39.693149 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG dbcounter [-] [103379] Writing DB stats nova_api:SELECT=8 {{(pid=103379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:11:39.746739 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-d0a2bed5-7b21-416a-b598-ff0f36009ae7 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:39.749284 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:11:39.749284 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: warnings.warn(msg) Jul 28 01:11:39.750501 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-d0a2bed5-7b21-416a-b598-ff0f36009ae7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:39.750961 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-d0a2bed5-7b21-416a-b598-ff0f36009ae7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:39.751743 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-d0a2bed5-7b21-416a-b598-ff0f36009ae7 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:39.752164 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-d0a2bed5-7b21-416a-b598-ff0f36009ae7 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:39.777625 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-d0a2bed5-7b21-416a-b598-ff0f36009ae7 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.090298 Jul 28 01:11:39.778183 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jul 28 01:11:39 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:11:40.651382 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:40.653241 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5226b349-c540-4ea1-b1c5-94177a17f4f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002654 Jul 28 01:11:40.653964 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jul 28 01:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:11:40.857472 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG nova.api.openstack.wsgi [None req-c53d262b-4321-4e65-9557-2fcea00bac20 admin admin] Calling method '>' {{(pid=103379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:11:40.860035 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 01:11:40.860035 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: warnings.warn(msg) Jul 28 01:11:40.861312 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c53d262b-4321-4e65-9557-2fcea00bac20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:40.861787 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c53d262b-4321-4e65-9557-2fcea00bac20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:40.862621 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c53d262b-4321-4e65-9557-2fcea00bac20 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:11:40.863071 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: DEBUG oslo_concurrency.lockutils [None req-c53d262b-4321-4e65-9557-2fcea00bac20 admin admin] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:11:40.886372 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: INFO nova.api.openstack.requestlog [None req-c53d262b-4321-4e65-9557-2fcea00bac20 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085799 Jul 28 01:11:40.886973 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: [pid: 103379|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jul 28 01:11:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:12:36.221740 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: Thu Jul 28 01:12:36 2022 - graceful shutdown triggered... Jul 28 01:12:36.222712 dv-cinder-815582-11-iscsi devstack@n-api.service[103379]: Gracefully killing worker 1 (pid: 103379)... Jul 28 01:12:36.225058 dv-cinder-815582-11-iscsi devstack@n-api.service[103380]: Gracefully killing worker 2 (pid: 103380)... Jul 28 01:12:36.225566 dv-cinder-815582-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 01:12:37.223001 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: worker 1 buried after 1 seconds Jul 28 01:12:37.223001 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: worker 2 buried after 1 seconds Jul 28 01:12:37.223001 dv-cinder-815582-11-iscsi devstack@n-api.service[103378]: goodbye to uWSGI. Jul 28 01:12:37.224667 dv-cinder-815582-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 01:12:37.225252 dv-cinder-815582-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 01:12:37.228311 dv-cinder-815582-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 01:12:37.240091 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 01:12:37 2022] *** Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: nodename: dv-cinder-815582-11-iscsi Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: machine: x86_64 Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: clock source: unix Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: pcre jit disabled Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: detected number of CPU cores: 4 Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: current working directory: / Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: detected binary path: /usr/bin/uwsgi-core Jul 28 01:12:37.242422 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: your processes number limit is 47680 Jul 28 01:12:37.243616 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: your memory page size is 4096 bytes Jul 28 01:12:37.243616 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: detected max file descriptor number: 2048 Jul 28 01:12:37.243616 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: lock engine: pthread robust mutexes Jul 28 01:12:37.243616 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: thunder lock: enabled Jul 28 01:12:37.243616 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 01:12:37.243616 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 01:12:37.289484 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: Python main interpreter initialized at 0x561f132089c0 Jul 28 01:12:37.289484 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: python threads support enabled Jul 28 01:12:37.289484 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: your server socket listen backlog is limited to 100 connections Jul 28 01:12:37.289484 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: your mercy for graceful operations on workers is 90 seconds Jul 28 01:12:37.290044 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 01:12:37.290044 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: *** Operational MODE: preforking *** Jul 28 01:12:37.290216 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: *** uWSGI is running in multiple interpreter mode *** Jul 28 01:12:37.290216 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: spawned uWSGI master process (pid: 117940) Jul 28 01:12:37.290397 dv-cinder-815582-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 01:12:37.292070 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: spawned uWSGI worker 1 (pid: 117958, cores: 1) Jul 28 01:12:37.292070 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: spawned uWSGI worker 2 (pid: 117960, cores: 1) Jul 28 01:12:37.292070 dv-cinder-815582-11-iscsi devstack@n-api.service[117940]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 01:12:37.959294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 01:12:37.959935 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 01:12:39.125416 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:12:39.125416 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: from cryptography.utils import int_from_bytes Jul 28 01:12:39.126064 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:12:39.126064 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: from cryptography.utils import int_from_bytes Jul 28 01:12:39.128433 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:12:39.128433 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: from cryptography.utils import int_from_bytes Jul 28 01:12:39.129049 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 01:12:39.129049 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: from cryptography.utils import int_from_bytes Jul 28 01:12:41.586936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 01:12:41.586936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 01:12:41.586936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 01:12:41.587626 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 01:12:41.587626 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 01:12:41.588112 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.588228 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.588543 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.588868 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.589203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.589518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.589848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.590171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.590507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.590769 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.591222 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.591460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-11-iscsi {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.591789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.592284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.592603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.592936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.593244 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.593569 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.593880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.594400 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.595882 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.595882 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.595882 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.596192 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.596503 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.596829 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.597148 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.597454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.597787 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.598108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.598525 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-11-iscsi {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.598882 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.599190 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.599508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.599936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.600253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.600570 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.600903 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.601236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.601550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.601921 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.602271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.602580 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.602935 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.603244 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.603561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.603888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.604202 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.604510 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.604845 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.605136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.605453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.605784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.606109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.606445 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.606699 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.606983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.607304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.607628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.607941 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.608252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.608561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.608869 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.609176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.609489 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.609795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.610102 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.610435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.610753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.611109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.611419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.611741 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.612168 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.612421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.612735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.613079 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.613403 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.613717 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.614035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.614358 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.614686 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.615015 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.615321 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.615642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.615976 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.616282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.616550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.617092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.617198 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.617451 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.617977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.618541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.619120 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.619675 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.620233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.620700 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.621268 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.621720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.622046 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.622298 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.622704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.623171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.623609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.623964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.624299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.624636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.625049 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.625470 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.625898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.626498 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.627092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.627647 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.628006 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.628334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.628720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.629233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.630151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.630712 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.631339 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.631890 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.632446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.633025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.633652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.634210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.634761 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.635353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.635719 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.636047 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.636367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.636684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.636996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.637332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.637666 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.637989 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.638302 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.638617 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.638979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.639337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.639674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.640024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.640360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.640700 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.641037 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.641360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.641682 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.642336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.642336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.642676 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.643002 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.643322 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.643650 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.643851 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 01:12:41.644379 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.644570 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 01:12:41.644726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.644726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.645004 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 01:12:41.645143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.645314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 01:12:41.645476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.645683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 01:12:41.645839 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.645992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.646161 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.646316 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.646467 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.646608 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.646745 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.646942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.647098 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.647250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.647390 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.647530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.647677 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.647825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.647990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.648139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.648280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.648418 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.648418 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.648704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.648919 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.649091 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.649091 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.649359 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-11-iscsi {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.649524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.649672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.649825 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.650807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.651002 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.651146 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.651146 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.651427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.651575 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.651716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.651861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.651861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.652140 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.652289 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.652428 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.652574 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.652736 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.652895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.653046 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.653219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.653368 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.653507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.653675 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.653835 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.653985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.654124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.654262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.654518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.654665 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.654803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.655032 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.655172 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.655309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.655446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.656116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.656116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.656295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.656380 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.656461 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.656540 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-11-iscsi {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.656618 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.656699 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.656772 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.656843 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.657022 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.657190 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.657502 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.657652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.657801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.657948 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.658089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.658287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.658460 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.658601 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.658748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.658950 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.659100 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.659279 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.659437 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.659653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.659807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.659970 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.660138 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.661159 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.661324 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.661493 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.661642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.661790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.661936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.662085 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.662237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.662377 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.662523 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.662672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.662819 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.663004 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.663153 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.663318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.663458 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.663604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.663750 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.663903 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.664050 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.664189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.664337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.664540 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.664540 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.665005 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.665289 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.665472 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.665615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.665754 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.665907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.666060 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.666207 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.666345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.666486 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.666637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.666785 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.666972 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.667123 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.667273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.667414 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.667561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.667701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.667839 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.667983 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.668139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.668387 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.668543 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.668690 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.668840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.668993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.669134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.669291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.669444 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.669586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.669732 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.669871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.670010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.670010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.670282 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.670282 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.671254 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.671436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.671671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.671671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.671961 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.672116 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.672257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.672396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.672533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.672681 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.672832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.672985 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.673132 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.673280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.673420 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.673558 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.673705 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.673856 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.674152 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.674299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.674447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.674587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.674735 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.675008 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.675163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.675163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.675447 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.675447 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.675745 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.675906 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.676046 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.676193 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.676332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.676531 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.676708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.676977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.677137 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.677278 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.677424 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.677578 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.677731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.677878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.678030 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.678168 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.678306 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.678453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.678600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.678747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.679006 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.679426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.679580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.679753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.679753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.680217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.680369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.680524 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.680682 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.681509 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.681691 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.681947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.682102 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.682250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.682400 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.682548 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.682688 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.682853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.682853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.683132 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.683305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.683446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.683585 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.683736 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.683875 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.684013 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.684159 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.684306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.684445 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.684592 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.684732 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.684878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.685040 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.685295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.685447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.685601 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.685741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.685891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.686038 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.686177 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.686317 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.686465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.686613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.686759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.686981 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.687132 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.687291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.687434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.687579 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.687720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.687857 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.687995 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.688146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.688286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.688426 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.688642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.688799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.688940 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.689105 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.689253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.689401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.689541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.689679 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.689816 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.689967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.690115 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.690261 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.690400 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.690546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.690699 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.690856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.691597 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.691766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.691916 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.692167 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.692322 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.692470 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.692619 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.692770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 01:12:41.692917 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.693061 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.693295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.693445 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.693586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.693744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.693884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.694031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.694179 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.694327 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.694469 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.694614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.694763 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.694968 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.695119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.695284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.695501 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.695702 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.695850 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.695999 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.696140 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.696279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.696425 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.696564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.696710 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.696859 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.697007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.697154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.697293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.697432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.697581 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.697736 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.697888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.698035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.698174 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.698321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.698469 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.698618 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.698757 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.698992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.699148 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.699330 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.699488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.699649 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.699790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.699929 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.700067 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.700213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.700363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.700503 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.700649 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.700789 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.700927 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.701083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.701843 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.701993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.702293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.702443 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.702583 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.702737 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.702906 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.703057 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.703208 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.703348 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.703494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.703494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.703770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.703909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.704066 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.704215 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.704353 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.704504 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.704645 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.704783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.704921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.705068 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.705209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.705209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.705500 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.705736 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.705736 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.706031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.706186 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.706327 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.706465 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.706603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.706742 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.707552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.707708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.707858 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.708007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.708157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.708315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.708454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.708601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.709015 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.709175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.709317 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.709465 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.709619 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.709773 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.709921 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.710068 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.710208 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.710355 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.710514 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.710715 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.710886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.711043 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.711197 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.712164 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.712352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.712630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.712777 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.712927 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.713074 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.713217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.713366 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.713521 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.713671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.713820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.713971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.714120 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.714269 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.714418 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.714566 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.714707 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.714866 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.715023 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.715177 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.715326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.715484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.715625 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.715883 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.716038 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.716188 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.716336 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.716476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.716615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.716764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.716914 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.717063 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.717211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.717376 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.717525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.717664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.717819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.717960 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.718109 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.718249 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.718395 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.718534 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.718692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.718912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.719101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.719241 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.719403 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.719553 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.719701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.719842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.719980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.720118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.720257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.720404 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.720545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.720684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.720830 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.720977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.721116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.721527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.722454 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.722609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.722996 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723110 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723193 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723364 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723622 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723877 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.723955 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724039 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724118 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724313 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724490 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724582 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724674 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724765 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724863 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.724948 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725039 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725214 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725577 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725656 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.725960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726046 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726136 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726227 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726311 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726408 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726493 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726792 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.726932 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.727038 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.727549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.727549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.727729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.727818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.727909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728376 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728461 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728557 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728727 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.728995 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729186 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729278 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729364 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729455 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729539 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729638 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729732 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729823 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.729916 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730000 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730505 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730597 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730779 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.730913 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731000 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731181 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731274 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731366 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731457 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731542 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731625 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731717 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.731930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732025 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732319 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732439 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.732920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733019 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733019 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733184 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733268 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733445 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733543 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733804 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733889 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.733980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734077 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734346 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734429 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734513 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734610 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734697 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734880 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.734978 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735159 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735608 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735700 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.735979 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736064 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736249 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736329 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.736921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.737027 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.737249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.737348 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.737541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.737704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.737842 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.737996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.738156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.738247 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.738467 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.738567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.738774 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.738956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.739118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.739210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.739432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.739605 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.739734 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.739834 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.740038 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.740130 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.740349 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.740450 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.740656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.740745 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.740962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.741060 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.741272 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.741375 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.741578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.741670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.741922 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.742021 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.742251 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.742363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.742591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.742692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.742937 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.743031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.743249 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.743350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.743556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.743698 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.743872 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.744014 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.744184 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.744329 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.744492 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.744637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.744815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.744950 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.745129 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.745263 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.745438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.745586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.745750 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.745896 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.746059 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.746200 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.746360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.746627 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.746731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.746966 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.747284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.747596 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.747811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.748135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.748450 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.748769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.749078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.749393 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.749705 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.750133 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.750299 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.750478 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.750636 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.750985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.751095 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.751305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.751404 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.751634 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.751784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.751931 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.752084 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.752257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.752433 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.752794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.752957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.752957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.753142 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.753232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.753329 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.753518 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.753697 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.753824 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.754025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.754127 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.754346 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.754448 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.755093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.755216 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.755512 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.755822 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.756133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.756438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.756528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.756741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.756842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.757197 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.757398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.757483 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.757558 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.757651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.757800 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.758024 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.758194 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.758298 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.758591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.758692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.758941 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.759038 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.759251 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.759342 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.759558 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.759653 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.759863 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.759970 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.760167 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.760259 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.760513 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.760607 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.760820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.760919 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.761162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.761255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.761492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.761585 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.761829 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.761924 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.762134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.762266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.762439 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.762602 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.763076 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.763186 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.763276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.763429 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.763525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.763600 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.763766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.764018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.764244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.764510 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.764743 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.764961 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.765179 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.765488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.765717 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.765946 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.766161 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.766424 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.766651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.766936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.767172 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.767383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.767606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.767844 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.768024 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.768187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.768347 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.768495 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.768642 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.768807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.768971 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.769133 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.769296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.769451 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.769597 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.769754 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.769917 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.770076 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.770249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.770249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.770538 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.770697 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.771024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.771192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.771355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.771515 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.771676 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.771827 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.771981 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.772253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.772409 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.772557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.772721 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.772908 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.773058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.773245 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.773402 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.773550 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.773694 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.773968 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774331 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774423 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774509 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774698 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774899 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.774988 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775342 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775743 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775839 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.775925 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776196 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776290 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776470 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776589 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.776979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777058 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777202 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777424 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777523 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777617 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777857 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.777981 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.778200 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.778312 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.778495 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.778594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.778815 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.778960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.779151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.779288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.779460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.779599 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.779761 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.779870 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.780109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.780209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.780421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.780541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.780752 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.780936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.781120 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.781268 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.781428 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.781565 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.781676 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.781824 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.781978 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.782087 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.782269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.782524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.782748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.783052 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.783249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.783446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.783649 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.783853 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.784051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.784258 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.784455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.784666 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.784873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.785096 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.785325 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.785543 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.785762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.785969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.786173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.786410 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.786619 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.786827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.787116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.787269 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.787431 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.787431 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.787711 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.787822 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.787918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788006 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788100 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788197 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788368 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788449 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788561 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788753 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.788985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789182 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789269 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789404 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.789966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.790052 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.790208 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.790365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.790525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.790669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.790823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.790990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.791133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.791419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.791587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.791746 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.791863 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.791952 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.792038 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.792212 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.792321 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.792562 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.792701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.792855 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.793010 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.793170 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.793391 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.793587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.793744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.793894 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.794078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.794219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.794375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.794581 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.794749 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.795085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.795253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.795407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.795559 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.795723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.795888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.796052 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.796234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.796387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.796554 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.796721 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.796875 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.797038 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.797273 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.797432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.797602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.797756 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.797903 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.798070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.798215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.798366 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.798584 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.798752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.798946 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.798946 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.799273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.799435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.799612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.799762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.799922 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.800088 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.800246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.800401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.800636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.800789 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.800958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.801104 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.801251 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.801400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.801552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.801709 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.801873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.802033 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.802178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.802323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.802473 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.802698 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.802961 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.803136 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.803336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.803506 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.803712 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.803856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.804015 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.804157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.804303 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.804447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.804601 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.804828 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.805022 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.805223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.805223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.805519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.805682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.805854 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.806008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.806598 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.806754 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.806920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.807092 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.807255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.807391 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.807594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.807594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.807830 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.807966 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808229 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808478 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808607 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808731 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808840 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.808966 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.809104 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.809243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.809383 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.809524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.809645 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.809764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.809896 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.810028 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.810160 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.810297 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.810421 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.810554 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.810678 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.810817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811184 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811325 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811479 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811610 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811718 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811822 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.811917 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812078 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812257 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812353 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812441 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812552 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812877 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.812966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.813085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.813179 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.813260 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.813341 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.814164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.814360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.814526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.814680 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.814864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.815089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.815317 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.815474 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.815627 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.815779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.815929 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.816100 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.816263 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.816425 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.816584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.816746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.816895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.817054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.817217 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.817377 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.817377 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.817750 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.817914 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.818065 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.818065 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.818363 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.818526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.818677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.818677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.819091 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.819258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.819421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.819594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.819594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.819885 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.820046 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.820206 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.820358 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.820519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.820706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.820868 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.821153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.821304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.821464 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.821622 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.821768 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.821908 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.822066 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.822215 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.822358 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.822505 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.822663 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.822821 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.823037 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.823218 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.823371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.823524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.823661 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.823890 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.824091 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.824245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.824396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.824396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.824689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.824689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.825000 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.825152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.825356 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.825510 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.825678 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.825833 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.826002 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.826167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.826323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.826477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.826648 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.826807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.827009 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.827176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.827344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.827564 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.827739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.827898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.828055 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.828219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.828381 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.828381 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.828677 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.828825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.828974 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.829176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.829348 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.829514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.829680 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.829839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.830005 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.830177 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.830461 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.830667 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.830879 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.831086 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.831300 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.831300 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.831585 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.831753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.831908 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.832069 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.832214 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.832369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.832529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.832691 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.832855 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.833076 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.833235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.833387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.833555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.833713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.833849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.834009 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.834213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.834213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.834524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.834687 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.834957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.835116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.835272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.835272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.835645 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.835645 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.835938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.836092 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.836309 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.836480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.836636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.836791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.837287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.837532 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.837693 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.837929 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.838154 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.838154 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.838455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.838609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.838766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.838951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.839102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.839261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.839479 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.839645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.839817 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.839975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.840121 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.840276 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.840427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.840577 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.840753 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.840919 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.841073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.841225 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.841371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.841519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.841681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.841848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.841994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.842151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.842307 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.842471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.842638 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.842786 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.843080 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.843271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.843445 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.843615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.843768 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.843970 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.844138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.844286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.844408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.844545 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.844670 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.844808 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.844808 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.845047 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.845187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.845310 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.845446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.845568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.845689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.845861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846002 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846285 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846423 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846423 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.846980 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.847134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.847282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.847437 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.847580 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.847734 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.847884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848275 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848470 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.848974 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849069 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849854 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849927 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.849998 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.850078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.850315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.850471 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.850614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.850770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.850986 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.851152 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.851315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.851468 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.851618 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.851765 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.851914 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852283 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852571 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852719 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852844 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.852935 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853028 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853184 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853267 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853412 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853483 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853728 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853800 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.853942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854104 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854324 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854731 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.854823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.855079 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.855352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.855446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.855677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.855945 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.856048 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.856280 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.856559 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.856663 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.856878 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.857161 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.857257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.857482 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.857792 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.857886 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.858144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.858398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.858497 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.858763 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.859094 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.859198 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.859414 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.859658 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.859841 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.860166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.860260 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.860546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.861363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.862522 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.864654 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.864903 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866067 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.866980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.867644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.867644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.867644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.867644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.867962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.868176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.868487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.868800 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.869120 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.869468 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.869794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.870116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.870433 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.870751 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.871088 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.871406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.871718 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.872029 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.872348 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.872683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.873002 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.873308 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.873741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.874056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.874374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.874697 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.875033 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.875357 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.875678 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.875999 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.876313 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.876628 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.876959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.877300 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.877627 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.877957 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.878260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.878568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.878891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.879208 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.879526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.880205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.880512 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.880819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.881133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.881440 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.881745 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.882048 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.882359 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.882663 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.882988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.883346 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.883650 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.883962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.884265 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.884577 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.884884 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.885188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.885495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.885800 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.886106 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.886400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.886740 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.887103 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.887421 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.887745 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.888057 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.888380 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.888696 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.889018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.889340 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.889658 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.889969 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.890301 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.890611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.890944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.891261 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.891565 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.891877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.892186 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.892522 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.892849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.893152 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.893480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.893803 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.894122 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.894429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.894739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.895090 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.895406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.895721 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.896028 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.896342 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.896703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.896952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.897266 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.897575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.897995 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.898222 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.898506 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.898940 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.899244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.899573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.899896 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.900248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.900566 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.900911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.901244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.901559 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.901880 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.902183 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 01:12:41.902425 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 01:12:41.922642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO dbcounter [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Registered counter for database nova_api Jul 28 01:12:41.950456 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_db.sqlalchemy.engines [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:41.958201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writer thread running {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:41.962382 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Registered counter for database nova_api Jul 28 01:12:41.984324 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:41.991754 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:42.017617 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.context [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7726ad62-7e36-457c-b9d8-9bde6568cf65(cell1) {{(pid=117960) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 01:12:42.021905 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:12:42.023564 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:12:42.024437 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:12:42.026665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:12:42.028792 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO dbcounter [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Registered counter for database nova_cell0 Jul 28 01:12:42.033163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO dbcounter [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Registered counter for database nova_cell1 Jul 28 01:12:42.041935 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_db.sqlalchemy.engines [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:42.042458 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_db.sqlalchemy.engines [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:42.049617 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writer thread running {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:42.050805 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.context [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7726ad62-7e36-457c-b9d8-9bde6568cf65(cell1) {{(pid=117958) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 01:12:42.051127 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writer thread running {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:42.055333 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:12:42.056896 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:12:42.057748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:12:42.060004 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:12:42.062172 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Registered counter for database nova_cell0 Jul 28 01:12:42.066646 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Registered counter for database nova_cell1 Jul 28 01:12:42.077267 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:42.083584 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:42.092182 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:42.093626 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:42.200299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO dbcounter [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Registered counter for database nova_cell0 Jul 28 01:12:42.210714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_db.sqlalchemy.engines [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:42.216131 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writer thread running {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:42.243169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Registered counter for database nova_cell0 Jul 28 01:12:42.250432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 01:12:42.255842 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 01:12:42.538953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: WARNING keystonemiddleware.auth_token [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:12:42.547054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: WARNING keystonemiddleware.auth_token [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:12:42.575291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:12:42.582711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:12:42.897152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: WARNING keystonemiddleware.auth_token [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:12:42.903999 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: WARNING keystonemiddleware.auth_token [None req-06a5f5fe-398e-4f9f-83c3-fb400b9de020 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:12:42.908832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f132089c0 pid: 117960 (default app) Jul 28 01:12:42.945050 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 01:12:42.951286 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-e74e4d03-c794-4100-8a8d-e00388f8052d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 01:12:42.956995 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f132089c0 pid: 117958 (default app) Jul 28 01:13:28.302312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:28.303896 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:28.305953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:28.306804 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:29.124427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-60b0690c-9985-478c-a473-ff1d368d27de tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e6f8820>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:29.189367 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:29.190193 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:29.191103 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:29.191855 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:29.991171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8e08944f-207d-41ba-8bf4-b200667243c5 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Action: 'create', calling method: .version_select at 0x7ff71e63eca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1092872483", "metadata": {"Type": "work"}}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:13:30.521159 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-60b0690c-9985-478c-a473-ff1d368d27de tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/91b2cfc7-15fa-4789-85e5-5c70fb7da090" status: 200 len: 350 microversion: 2.1 time: 1.774060 Jul 28 01:13:30.539169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1/1] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:28 2022] GET /compute/v2.1/os-volumes/91b2cfc7-15fa-4789-85e5-5c70fb7da090 => generated 350 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:13:31.798486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8e08944f-207d-41ba-8bf4-b200667243c5 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.510258 Jul 28 01:13:31.800238 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Jul 28 01:13:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3518 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 01:13:31.816194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c518a071-e59d-4c55-a9a8-eab18084a570 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Calling method '.version_select at 0x7ff71e534b80>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:31.946074 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c518a071-e59d-4c55-a9a8-eab18084a570 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb" status: 200 len: 353 microversion: 2.1 time: 0.134072 Jul 28 01:13:31.946864 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:31 2022] GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:13:32.810293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-befca209-1cbc-4c5b-96f9-616b4f3df436 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e499af0>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:32.962455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-de1c5943-8ece-4e4e-b757-0b9e65d944cf tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Calling method '.version_select at 0x7ff71e534c10>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:33.226223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-de1c5943-8ece-4e4e-b757-0b9e65d944cf tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb" status: 200 len: 354 microversion: 2.1 time: 0.269441 Jul 28 01:13:33.227723 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:32 2022] GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb => generated 354 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:13:33.238048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-befca209-1cbc-4c5b-96f9-616b4f3df436 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e2d1a5d1-36ca-497b-a5b5-94481f9eeb45" status: 200 len: 351 microversion: 2.1 time: 0.438136 Jul 28 01:13:33.242031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-024a3832-b002-415a-b809-e265b17761ad tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Calling method '.version_select at 0x7ff71e5073a0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:33.247010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 2/5] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:32 2022] GET /compute/v2.1/os-volumes/e2d1a5d1-36ca-497b-a5b5-94481f9eeb45 => generated 351 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:13:33.737695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-604639306", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "networks": [{"uuid": "b3b8c70a-85f4-4b76-9f67-3297a3a800f4"}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:13:33.763968 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-024a3832-b002-415a-b809-e265b17761ad tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb" status: 200 len: 354 microversion: 2.1 time: 0.527573 Jul 28 01:13:33.764556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:33 2022] GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb => generated 354 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:13:33.789793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3eb78fc3-1ada-4771-93b5-81846a5098eb tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Calling method '.version_select at 0x7ff71e507a60>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:33.961609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] validate_networks() for [('b3b8c70a-85f4-4b76-9f67-3297a3a800f4', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:13:34.000900 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3eb78fc3-1ada-4771-93b5-81846a5098eb tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb" status: 202 len: 0 microversion: 2.1 time: 0.215266 Jul 28 01:13:34.002283 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 5/7] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:13:33 2022] DELETE /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 01:13:34.011069 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b7ed3b56-7d32-4fb2-8691-e9cf1601edc7 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Calling method '.version_select at 0x7ff71e507b80>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:34.116333 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b7ed3b56-7d32-4fb2-8691-e9cf1601edc7 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb" status: 200 len: 353 microversion: 2.1 time: 0.108707 Jul 28 01:13:34.117669 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 6/8] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:34 2022] GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:13:35.112314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5c3e9e21-606c-4773-93fa-1816da13887e tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e5075e0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:35.233322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5c3e9e21-606c-4773-93fa-1816da13887e tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/5d278028-3b69-4ba2-89eb-bf8e904b2980" status: 200 len: 351 microversion: 2.1 time: 0.124842 Jul 28 01:13:35.234651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 7/9] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:35 2022] GET /compute/v2.1/os-volumes/5d278028-3b69-4ba2-89eb-bf8e904b2980 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:13:35.240942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-861b9830-95ce-4c73-a861-00477d0fe375 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Calling method '.version_select at 0x7ff71e534a60>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:35.282215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-861b9830-95ce-4c73-a861-00477d0fe375 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] HTTP exception thrown: Volume adbcfd70-5f06-4f65-9ce0-e679e9033edb could not be found. Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-861b9830-95ce-4c73-a861-00477d0fe375 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Request method failure captured: Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb HTTP/1.1 Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eK4rFKD-0Wed6HZiJpGCMy5cupWjnNdTf2lJr40-kzEZsvSRzxGYmWjt0tkaofRy4Ro8rJbWB7ry8ZR8PHrdpLskqQbIZfAMx8HEMzOYCxMFjy5SgwVCaBKhMD0GgKOOBnImO0N44UUXifi4__8e144WP9uoUCinx8Uuf7Qz7QGasg Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 8fe8407ac0834896b8693848d6c023d8 Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesGetTestJSON-318428240 Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:13:35.288590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8fe8407ac0834896b8693848d6c023d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8fe8407ac0834896b8693848d6c023d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8fe8407ac0834896b8693848d6c023d8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8fe8407ac0834896b8693848d6c023d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesGetTestJSON-318428240 Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 8fe8407ac0834896b8693848d6c023d8 Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesGetTestJSON-318428240 Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesGetTestJSON-318428240-project Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 3fcfb45bc3bc48ec9c6cdd33d18b66b0 Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesGetTestJSON-318428240-project Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Volume adbcfd70-5f06-4f65-9ce0-e679e9033edb could not be found. Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'adbcfd70-5f06-4f65-9ce0-e679e9033edb'} Jul 28 01:13:35.289653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume adbcfd70-5f06-4f65-9ce0-e679e9033edb could not be found. (HTTP 404) (Request-ID: req-4139ffb9-e8a0-4c2e-925e-814a30db8a63) Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:13:35.290284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:13:35.291156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume adbcfd70-5f06-4f65-9ce0-e679e9033edb could not be found. Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 01:13:35.292035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume adbcfd70-5f06-4f65-9ce0-e679e9033edb could not be found. Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume adbcfd70-5f06-4f65-9ce0-e679e9033edb could not be found. Jul 28 01:13:35.293051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:13:35.296546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-861b9830-95ce-4c73-a861-00477d0fe375 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] Returning 404 to user: Volume adbcfd70-5f06-4f65-9ce0-e679e9033edb could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:13:35.297995 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-861b9830-95ce-4c73-a861-00477d0fe375 tempest-VolumesGetTestJSON-318428240 tempest-VolumesGetTestJSON-318428240-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb" status: 404 len: 109 microversion: 2.1 time: 0.061960 Jul 28 01:13:35.299564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 8/10] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:13:35 2022] GET /compute/v2.1/os-volumes/adbcfd70-5f06-4f65-9ce0-e679e9033edb => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:13:35.319849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-489afcf1-f883-4cc4-8e7b-c2544d542d95 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e47a430>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:35.588369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-489afcf1-f883-4cc4-8e7b-c2544d542d95 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.286809 Jul 28 01:13:35.590878 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 9/11] 10.222.0.17 () {58 vars in 1134 bytes} [Thu Jul 28 01:13:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:35.606556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cd16795f-972f-4f2b-b3fc-615f976241b1 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e6f8820>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:35.794083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cd16795f-972f-4f2b-b3fc-615f976241b1 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.193180 Jul 28 01:13:35.795222 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 10/12] 10.222.0.17 () {58 vars in 1149 bytes} [Thu Jul 28 01:13:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:13:35.810217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e799c687-13df-4b1c-808e-6ad1c6c70c23 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e47ed30>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:35.916054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:13:35.916507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:13:35.916945 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:13:35.917634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:13:35.918190 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:13:35.946318 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:35.949326 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:35.950471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:35.951112 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:36.012416 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Getting quotas for project c8b3087180c642a78010ed1382cf1868. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:13:36.020398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Getting quotas for user 84b16be4f85b440a9e3afea73ffc7871 and project c8b3087180c642a78010ed1382cf1868. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:13:36.035734 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:13:36.039081 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:13:36.049253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e799c687-13df-4b1c-808e-6ad1c6c70c23 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.243237 Jul 28 01:13:36.050007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 11/13] 10.222.0.17 () {58 vars in 1134 bytes} [Thu Jul 28 01:13:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:36.065041 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a8a1e8ee-c32b-45cd-ae50-824f0554d49b tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e47e9d0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:36.183657 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a3410a39-369a-429a-9d30-e9b6ae2eb3b3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.778421 Jul 28 01:13:36.185143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 3/14] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:13:36.198194 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-36d3a0f4-b917-4f50-af83-e321357c2f0d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:36.199007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-36d3a0f4-b917-4f50-af83-e321357c2f0d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:36.240500 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a8a1e8ee-c32b-45cd-ae50-824f0554d49b tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.180964 Jul 28 01:13:36.241240 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 12/15] 10.222.0.17 () {58 vars in 1167 bytes} [Thu Jul 28 01:13:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:13:36.257314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c88ebe47-8b0b-476d-a66e-88e42edefcbc tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e534820>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:36.356363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-36d3a0f4-b917-4f50-af83-e321357c2f0d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:36.379327 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-36d3a0f4-b917-4f50-af83-e321357c2f0d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1214 microversion: 2.1 time: 0.185661 Jul 28 01:13:36.381816 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 4/16] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:36 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:13:36.512780 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c88ebe47-8b0b-476d-a66e-88e42edefcbc tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.260144 Jul 28 01:13:36.513842 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 13/17] 10.222.0.17 () {58 vars in 1170 bytes} [Thu Jul 28 01:13:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:13:36.526995 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f8d7ac15-6156-47eb-bdc9-5257719411a2 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71dbb19d0>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:36.701458 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f8d7ac15-6156-47eb-bdc9-5257719411a2 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.178416 Jul 28 01:13:36.702046 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 5/18] 10.222.0.17 () {58 vars in 1155 bytes} [Thu Jul 28 01:13:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:36.716124 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-30594e7f-3e14-429b-a1cb-7a62081635ce tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71e47b040>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:36.850986 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-30594e7f-3e14-429b-a1cb-7a62081635ce tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.139481 Jul 28 01:13:36.852089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 14/19] 10.222.0.17 () {58 vars in 1188 bytes} [Thu Jul 28 01:13:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:13:36.864990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4d8e64cd-0afc-4bf4-9bdc-efbb71ac28f7 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] Calling method '.version_select at 0x7ff71d374790>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:37.006586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4d8e64cd-0afc-4bf4-9bdc-efbb71ac28f7 tempest-VolumesTestJSON-1407257803 tempest-VolumesTestJSON-1407257803-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.145327 Jul 28 01:13:37.007661 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 6/20] 10.222.0.17 () {58 vars in 1155 bytes} [Thu Jul 28 01:13:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:37.406870 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c10e1536-daa6-4731-8aa0-b423177eac31 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:37.407703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c10e1536-daa6-4731-8aa0-b423177eac31 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:38.039146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c10e1536-daa6-4731-8aa0-b423177eac31 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:38.074797 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c10e1536-daa6-4731-8aa0-b423177eac31 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1214 microversion: 2.1 time: 0.674298 Jul 28 01:13:38.079746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 15/21] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:37 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1214 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:39.107492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:39.108123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:39.148526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:39.148983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:39.149783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:39.150287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:40.096625 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:40.169351 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f0717d00-b0d2-469f-b949-c6ce29f8e5cd tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1266 microversion: 2.1 time: 1.070201 Jul 28 01:13:40.176284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 7/22] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:39 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1266 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:41.209008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:41.209634 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:41.221758 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:41.222608 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:41.226607 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:41.230409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:41.535136 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:41.562875 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ad5cae7e-1185-4224-8f59-3a9bf6a7dca7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1272 microversion: 2.1 time: 0.359453 Jul 28 01:13:41.569739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 16/23] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:41 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:42.593617 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:42.595565 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:42.607095 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:42.608048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:42.615274 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:42.617025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:42.877810 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:42.897403 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-aaa68f96-8798-4bd9-b5b3-e84918438d97 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1272 microversion: 2.1 time: 0.302297 Jul 28 01:13:42.903653 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 8/24] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:42 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:13:43.928662 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:43.929407 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:43.948801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:43.953988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:43.955498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:43.962012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:44.517567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:44.531210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a3f5a9a8-4b14-4071-9487-eea25d3ef7a8 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1272 microversion: 2.1 time: 0.603230 Jul 28 01:13:44.535956 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 17/25] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:43 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1272 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:45.558306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:45.559082 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:45.583185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:45.583739 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:45.587497 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:45.587958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:45.954707 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:45.977401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b48322c0-ce92-43c2-917e-06d1c50f92da tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1272 microversion: 2.1 time: 0.416755 Jul 28 01:13:45.979329 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 9/26] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:45 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:46.999495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:47.000262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:47.024737 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:47.027565 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:47.033349 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:47.039209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:48.074881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:48.564558 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:48.575615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-68d9de8e-3411-4351-88d2-8f1db5fef2c1 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 1.577783 Jul 28 01:13:48.577769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 18/27] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:46 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:49.604388 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:49.604388 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:49.614601 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:49.615385 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=8 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:49.635274 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:49.635997 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:49.636759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:49.645862 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:50.964044 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:50.973471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9ef10677-5ac3-48e1-a1a4-f06e0208324b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 1.375517 Jul 28 01:13:50.980467 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 10/28] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:49 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:52.022986 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:52.024241 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:52.043174 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:52.043841 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:52.044677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:52.052093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:52.730499 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-741775982", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:13:52.918996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] validate_networks() for [('8f65178e-aa89-435c-9fed-639dfc5bec3f', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:13:53.371786 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:53.388682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-92b34204-2f8f-46b0-b743-a9252fb6b2d6 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 1.369103 Jul 28 01:13:53.389760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 19/29] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:52 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:53.874033 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-71fd7022-06b4-4112-837e-9ff5cfa70b20 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'create', calling method: .version_select at 0x7ff71e3bff70>, body: {"keypair": {"name": "tempest-keypair-841192381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExeK5rmT5Lj14qHbU7cOdoUciLgZQtZ6VPqh1NaeMb8iduxd0A1MnXpwv67QxEAVkm5d3hwr6wk8TBJXnAp9ut0kFnaVhPXaaZsr5ih9YM1HFnvq5dMfOLHnYzRJTP1LA=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:13:54.008793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-71fd7022-06b4-4112-837e-9ff5cfa70b20 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for project 347bcdc7636e4f93af2597f853926b13. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:13:54.029289 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-71fd7022-06b4-4112-837e-9ff5cfa70b20 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for user c8ab1df6f15143de8f922a626317fa9c and project 347bcdc7636e4f93af2597f853926b13. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:13:54.127637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-71fd7022-06b4-4112-837e-9ff5cfa70b20 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.736401 Jul 28 01:13:54.128305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 20/30] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:13:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:13:54.410605 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:54.412021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:54.435582 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:54.436158 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:54.437170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:54.437807 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:55.963908 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:13:55.964689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:13:55.965401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:13:55.966264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:13:55.966822 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:13:55.995998 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:55.997140 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:56.000886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:56.002356 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:56.104008 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:13:56.125051 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for user 018eb80709e94d5e8653fb6eeb342c54 and project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:13:56.186295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:13:56.188500 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:13:56.412715 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1fabf3d1-94ca-40ae-a16c-f1823335a16a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.227437 Jul 28 01:13:56.416705 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 11/31] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:13:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 4234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 01:13:57.135619 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cdd64b72-5674-425e-9557-21b145299cfb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'create', calling method: .version_select at 0x7ff71d2bd820>, body: {"keypair": {"name": "tempest-keypair-333034081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd5ko4K188j2jA2ZrihBTaBGtdtV2s/iKX161t/Im8RT3VoV4pszZKhDpSLX4rJrkx0JauGGQAe3G6JekcUbMKlrvHRxoj9WlZYVkuG3YafgSAuQWMlnNR2Z1YSoAU1sQ=="}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:13:57.262577 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-cdd64b72-5674-425e-9557-21b145299cfb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:13:57.307760 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-cdd64b72-5674-425e-9557-21b145299cfb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for user 166cef282cb24a5aaef0ca8b28f02e56 and project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:13:57.430561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-cdd64b72-5674-425e-9557-21b145299cfb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.006797 Jul 28 01:13:57.431289 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 12/32] 10.222.0.17 () {62 vars in 1200 bytes} [Thu Jul 28 01:13:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1014 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 01:13:57.522188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:57.536170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-83c0af10-4268-4715-8bf4-f691599b632b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 3.129087 Jul 28 01:13:57.537418 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 21/33] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:54 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 3132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:57.571860 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fe576437-22b1-49e9-8c6f-1664971cd906 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:57.573997 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fe576437-22b1-49e9-8c6f-1664971cd906 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:58.092545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fe576437-22b1-49e9-8c6f-1664971cd906 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:58.108885 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fe576437-22b1-49e9-8c6f-1664971cd906 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1221 microversion: 2.1 time: 0.565154 Jul 28 01:13:58.110279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 22/34] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:57 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1221 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:13:58.303450 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-ca1be98f-ec21-47e2-9217-deaba2c337aa req-65296ffa-8250-4996-a8cf-babfb0bed1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae47659-3cd8-4380-a4bf-e8ed0066a9a0", "tag": "9f1daf0a-6008-4ac7-9309-150096a05481"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:13:58.341533 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-ca1be98f-ec21-47e2-9217-deaba2c337aa req-65296ffa-8250-4996-a8cf-babfb0bed1f5 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:58.343728 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-ca1be98f-ec21-47e2-9217-deaba2c337aa req-65296ffa-8250-4996-a8cf-babfb0bed1f5 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:58.414315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=29 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:58.437273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-ca1be98f-ec21-47e2-9217-deaba2c337aa req-65296ffa-8250-4996-a8cf-babfb0bed1f5 service nova] Creating event network-changed:9f1daf0a-6008-4ac7-9309-150096a05481 for instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 on hv-cinder-81558 Jul 28 01:13:58.450014 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-ca1be98f-ec21-47e2-9217-deaba2c337aa req-65296ffa-8250-4996-a8cf-babfb0bed1f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 01:13:58.455733 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d87f4120-8225-4503-8870-f31a5cf149eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:58.458783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d87f4120-8225-4503-8870-f31a5cf149eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:58.465181 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d87f4120-8225-4503-8870-f31a5cf149eb None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:58.466517 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d87f4120-8225-4503-8870-f31a5cf149eb None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:58.524755 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.compute.rpcapi [None req-d87f4120-8225-4503-8870-f31a5cf149eb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 01:13:58.528146 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d87f4120-8225-4503-8870-f31a5cf149eb None None] Releasing lock "compute-rpcapi-router" {{(pid=117960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 01:13:58.561270 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:13:58.562716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:13:58.576703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:58.577606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:58.578653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:13:58.593146 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d87f4120-8225-4503-8870-f31a5cf149eb None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.156337 Jul 28 01:13:58.594053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 13/35] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:13:58.594682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:13:58.730338 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1642866935", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:13:58.786252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:13:58.928312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] validate_networks() for [('8f65178e-aa89-435c-9fed-639dfc5bec3f', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:13:59.753510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:13:59.764066 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9bbbbf11-d010-42e5-9726-27c9929f204d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 1.206974 Jul 28 01:13:59.764662 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 23/36] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:13:58 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:00.327825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1277022918", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8b9b78b-8c4e-43b1-bef2-ab7b40ebdc5e"}], "security_groups": [{"name": "tempest-securitygroup--813458131"}], "key_name": "tempest-keypair-841192381", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:00.351096 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:00.724559 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] validate_networks() for [('a8b9b78b-8c4e-43b1-bef2-ab7b40ebdc5e', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:14:00.730873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:14:00.732748 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:14:00.733531 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:14:00.734214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:14:00.734953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:14:00.753135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:00.754005 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:00.755487 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:00.758564 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:00.805536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:14:00.810702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for user 018eb80709e94d5e8653fb6eeb342c54 and project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:14:00.824116 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:14:00.827265 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:14:00.882453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6896fa70-620a-44af-8a93-09cdc04df00c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.177118 Jul 28 01:14:00.890071 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 14/37] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:13:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:14:00.896636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:00.897781 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:00.905319 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:00.906201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:00.907257 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:00.907924 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:01.776196 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:01.797464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e0cc8cf6-08b6-4a6d-96c6-39ef5c257270 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.895162 Jul 28 01:14:01.812292 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 15/38] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:00 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:01.834740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:01.843749 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:01.870419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:01.871264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:01.872227 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:01.874109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:02.000349 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:02.016991 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-25ffde1d-a426-4cd0-8250-d63815852e0d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1226 microversion: 2.1 time: 0.201183 Jul 28 01:14:02.020667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 16/39] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:01 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:02.822738 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:02.823448 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:02.841031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:02.845078 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:02.846943 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:02.849495 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:04.647634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:04.663409 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7380b144-9862-4790-a5a2-230298c49fe9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 1.845092 Jul 28 01:14:04.664386 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 17/40] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:02 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:04.675885 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:04.680465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:04.696672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:04.699840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:04.701128 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:04.704590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:04.983493 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:14:04.983937 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:14:04.984434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:14:04.984975 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:14:04.985293 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:14:04.994367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:05.003090 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:05.007843 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:05.009564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:05.010255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:05.044908 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for project 347bcdc7636e4f93af2597f853926b13. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:14:05.050735 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for user c8ab1df6f15143de8f922a626317fa9c and project 347bcdc7636e4f93af2597f853926b13. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:14:05.078225 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2134038b-65c6-48e5-8f69-9faadadcc0a4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1280 microversion: 2.1 time: 0.412387 Jul 28 01:14:05.085842 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:14:05.089841 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:14:05.114504 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 18/41] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:04 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1280 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:05.242225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0577801e-db6c-437e-8c44-cbd4924e1908 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.919282 Jul 28 01:14:05.244316 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 24/42] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:14:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 4923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 01:14:05.260475 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4887f130-a809-4996-be81-8e7b732ac011 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:05.262047 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4887f130-a809-4996-be81-8e7b732ac011 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:05.512686 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4887f130-a809-4996-be81-8e7b732ac011 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:05.534236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4887f130-a809-4996-be81-8e7b732ac011 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1237 microversion: 2.1 time: 0.280894 Jul 28 01:14:05.538517 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 19/43] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:05 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1237 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:05.693553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:05.695510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:05.724408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:05.725545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:05.726547 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:05.727176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:06.038315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:06.049157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-163b2e98-71d9-4ea4-a9ec-da63c2ab6e2c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.362768 Jul 28 01:14:06.050354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 25/44] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:05 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:06.140860 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:06.141477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:06.150813 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:06.160831 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:06.161781 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:06.162245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:06.202822 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1584255834", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79d1ca3f-e23e-4848-9d9a-982b12f210b8"}], "security_groups": [{"name": "tempest-securitygroup--565255108"}], "key_name": "tempest-keypair-333034081", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:06.294276 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:06.306446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8ec46bdc-a715-45e1-b5ee-da6a81d474c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1280 microversion: 2.1 time: 0.167970 Jul 28 01:14:06.307616 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 20/45] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:06 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:06.354274 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] validate_networks() for [('79d1ca3f-e23e-4848-9d9a-982b12f210b8', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:14:06.560780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:06.561766 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:06.569813 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:06.570485 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:06.571489 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:06.574600 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:06.783929 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:06.801880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-338432a1-b48d-4825-a6bf-99585e76ea87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1289 microversion: 2.1 time: 0.235547 Jul 28 01:14:06.801880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 21/46] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:06 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1289 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:07.070343 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:07.071281 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:07.086525 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:07.088165 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:07.094928 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:07.100968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:08.529860 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:08.556247 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-81d5209f-3042-4f4d-a6ed-03f6970815e7 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 1.490224 Jul 28 01:14:08.575647 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 22/47] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:07 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:08.593115 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:08.593756 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:08.619326 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:08.619779 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:08.620594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:08.621049 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:08.670253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:14:08.671320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:14:08.672003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:14:08.672220 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:14:08.672969 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:14:08.693253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:08.695832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:08.699185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:08.699703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:08.724666 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:14:08.734639 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for user 166cef282cb24a5aaef0ca8b28f02e56 and project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:14:08.755125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:14:08.760175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:14:08.875969 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7fec5a4e-2bfe-4067-bc82-c6abb9faad86 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.681079 Jul 28 01:14:08.880278 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 26/48] 10.222.0.17 () {62 vars in 1188 bytes} [Thu Jul 28 01:14:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 01:14:08.885636 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:08.886262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:08.895215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:08.896586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:08.897920 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:08.898563 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:09.000735 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:09.009793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2511a5f2-1e87-4e37-8c88-69f6fe632257 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1295 microversion: 2.1 time: 0.128364 Jul 28 01:14:09.027725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 27/49] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:08 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:09.041679 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-99beb2a1-1324-473d-bc78-4956996f17ed tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:09.042549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-99beb2a1-1324-473d-bc78-4956996f17ed tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:09.196479 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-99beb2a1-1324-473d-bc78-4956996f17ed tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:09.200252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:09.208126 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-99beb2a1-1324-473d-bc78-4956996f17ed tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:09.211074 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-eff107f3-8099-4f11-bc7d-6347f8ce96cd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.634174 Jul 28 01:14:09.212272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 23/50] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:08 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:09.213747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-99beb2a1-1324-473d-bc78-4956996f17ed tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:09.217911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-99beb2a1-1324-473d-bc78-4956996f17ed tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1281 microversion: 2.20 time: 0.188812 Jul 28 01:14:09.218903 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 28/51] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:09 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:09.554426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-8f6aa6fd-c258-4e5e-8476-d902a55d219e req-13a3cd2a-6a4f-41de-a56b-c9b6d761ac16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae47659-3cd8-4380-a4bf-e8ed0066a9a0", "name": "network-vif-plugged", "status": "completed", "tag": "9f1daf0a-6008-4ac7-9309-150096a05481"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:09.578166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:09.578799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:09.586369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8f6aa6fd-c258-4e5e-8476-d902a55d219e req-13a3cd2a-6a4f-41de-a56b-c9b6d761ac16 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:09.590487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:09.593200 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8f6aa6fd-c258-4e5e-8476-d902a55d219e req-13a3cd2a-6a4f-41de-a56b-c9b6d761ac16 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:09.597936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:09.600073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:09.602169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:09.634553 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-8f6aa6fd-c258-4e5e-8476-d902a55d219e req-13a3cd2a-6a4f-41de-a56b-c9b6d761ac16 service nova] Creating event network-vif-plugged:9f1daf0a-6008-4ac7-9309-150096a05481 for instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 on hv-cinder-81558 Jul 28 01:14:09.666048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-8f6aa6fd-c258-4e5e-8476-d902a55d219e req-13a3cd2a-6a4f-41de-a56b-c9b6d761ac16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.451812 Jul 28 01:14:09.704350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 24/52] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:10.040739 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:10.042089 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:10.059428 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:10.059872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:10.060671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:10.064479 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:10.663031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:10.671942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8f3930f0-2275-4800-84fa-263fe43afe19 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 1.097945 Jul 28 01:14:10.672655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 29/53] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:09 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:10.693848 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:10.700620 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:10.703840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:10.720316 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:10.723690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9dae14be-8d71-40c2-9ccb-71c203606571 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.691880 Jul 28 01:14:10.725848 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:10.737182 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:10.743404 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:10.760686 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 25/54] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:10 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:10.798738 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:10.805140 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:10.814928 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:10.827413 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:10.830209 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:10.832167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:10.835030 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:11.270339 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:11.284213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:11.292104 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:11.299622 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-211b3cee-77ab-40a7-87b0-89a9e23dacf2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1341 microversion: 2.20 time: 0.520322 Jul 28 01:14:11.300461 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 26/55] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:10 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1341 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:11.582701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:11.586607 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=63 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:11.599004 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0d3a10e2-fb75-4870-8b20-ae04d9d8afb5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.925048 Jul 28 01:14:11.600072 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 30/56] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:10 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:11.652930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-57c873c1-84c7-4896-9382-e5ac4cf4771c req-a9b2b949-0377-43ea-9faa-2114a2230b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26acfa5-94f2-4d1d-8bfd-9f82e73861f8", "tag": "77e6a437-69fc-4d47-b75b-cc39937c21bd"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:11.664115 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-57c873c1-84c7-4896-9382-e5ac4cf4771c req-a9b2b949-0377-43ea-9faa-2114a2230b2f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:11.664572 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-57c873c1-84c7-4896-9382-e5ac4cf4771c req-a9b2b949-0377-43ea-9faa-2114a2230b2f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:11.678739 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-57c873c1-84c7-4896-9382-e5ac4cf4771c req-a9b2b949-0377-43ea-9faa-2114a2230b2f service nova] Creating event network-changed:77e6a437-69fc-4d47-b75b-cc39937c21bd for instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 on hv-cinder-81558 Jul 28 01:14:11.694014 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:11.694630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:11.698367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-57c873c1-84c7-4896-9382-e5ac4cf4771c req-a9b2b949-0377-43ea-9faa-2114a2230b2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283442 Jul 28 01:14:11.699753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 27/57] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:11.705603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:11.706793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:11.707783 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:11.708375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:11.783222 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:11.784544 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:11.791773 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:11.792326 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:11.793266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:11.793684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:12.287814 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:12.299246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ed67b0b3-42e9-4d51-882f-8c500437908f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.520645 Jul 28 01:14:12.299856 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 28/58] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:11 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:12.320919 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:12.329353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:12.330178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:12.333603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2cc71fa9-aeb4-48af-9849-9c6aa9a218a3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.643641 Jul 28 01:14:12.334690 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 31/59] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:11 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:12.356383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:12.356904 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:12.357853 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:12.358359 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:12.490351 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:12.505577 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:12.508728 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:12.511141 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f0e9a365-a36e-4d7a-adfa-46ec90e7fa95 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1339 microversion: 2.20 time: 0.187044 Jul 28 01:14:12.512162 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 29/60] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:12 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:12.637885 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:12.641449 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:12.662178 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:12.663978 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:12.683350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:12.684176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:12.992677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:13.002758 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-396864f4-0b7f-46f4-90a7-2d1a6f5f1a61 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.384928 Jul 28 01:14:13.008189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 32/61] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:12 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:13.102542 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-189f60ef-21e5-475a-a687-b4044e86229b req-6c871fb3-8d09-4757-a14f-1351c05908e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3c75a9-eb23-4978-bb95-53fe1e079f36", "tag": "5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:13.139119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-189f60ef-21e5-475a-a687-b4044e86229b req-6c871fb3-8d09-4757-a14f-1351c05908e1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:13.141001 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-189f60ef-21e5-475a-a687-b4044e86229b req-6c871fb3-8d09-4757-a14f-1351c05908e1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:13.161406 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-189f60ef-21e5-475a-a687-b4044e86229b req-6c871fb3-8d09-4757-a14f-1351c05908e1 service nova] Creating event network-changed:5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef for instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 on hv-cinder-81558 Jul 28 01:14:13.172042 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-189f60ef-21e5-475a-a687-b4044e86229b req-6c871fb3-8d09-4757-a14f-1351c05908e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077253 Jul 28 01:14:13.175597 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 30/62] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:13.322636 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:13.323231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:13.329915 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:13.336012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:13.337062 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:13.337525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:13.356116 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:13.357168 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:13.368127 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:13.369959 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:13.372863 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:13.373524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:14.249625 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:14.259821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b5858b14-ecd1-4096-a468-6eddebb0eb26 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.942138 Jul 28 01:14:14.261906 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 33/63] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:13 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:14.274739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:14.276203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:14.283681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:14.284344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:14.285137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:14.285624 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:14.285858 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:14.294232 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-bd25eb1c-d0dd-4c2b-9ced-81bf86f6f59e tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.942400 Jul 28 01:14:14.307785 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 31/64] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:13 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1314 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:14.314534 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-44ae0ca3-c011-4ef2-9423-dd375d8e4d9c req-30f9a700-fa6a-4604-9f5f-cf352f02bd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86f9d31b-737a-452f-b047-b6be2bea377b", "tag": "b7d3de87-244d-4779-a3e5-9f83c3f0ed25"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:14.327533 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-44ae0ca3-c011-4ef2-9423-dd375d8e4d9c req-30f9a700-fa6a-4604-9f5f-cf352f02bd3d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:14.328397 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-44ae0ca3-c011-4ef2-9423-dd375d8e4d9c req-30f9a700-fa6a-4604-9f5f-cf352f02bd3d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:14.345982 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-44ae0ca3-c011-4ef2-9423-dd375d8e4d9c req-30f9a700-fa6a-4604-9f5f-cf352f02bd3d service nova] Creating event network-changed:b7d3de87-244d-4779-a3e5-9f83c3f0ed25 for instance 86f9d31b-737a-452f-b047-b6be2bea377b on hv-cinder-81558 Jul 28 01:14:14.352494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-44ae0ca3-c011-4ef2-9423-dd375d8e4d9c req-30f9a700-fa6a-4604-9f5f-cf352f02bd3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043023 Jul 28 01:14:14.353800 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 32/65] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:14.361165 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:14.362773 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:14.373347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:14.374270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:14.375554 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:14.376210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:14.588997 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:14.600889 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:14.604123 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:14.605438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-76d465b6-e281-487e-b015-b12fc319a5a2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.342411 Jul 28 01:14:14.606339 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:14 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:14.634862 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:14.649532 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e040106f-5992-486c-abfb-e19a5de54531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.294215 Jul 28 01:14:14.650491 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 33/67] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:14 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:15.296741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:15.301040 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:15.319836 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:15.320562 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:15.333102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:15.333758 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:15.334590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:15.335240 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:15.339426 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:15.339730 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:15.340144 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:15.342960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:15.407108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=100 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:15.524658 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=18 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:15.915808 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:15.926959 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-049f140c-6c97-44ac-969c-8fa0ad3f2cd9 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1501 microversion: 2.1 time: 0.609520 Jul 28 01:14:15.927829 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 34/68] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:15 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1501 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:15.942205 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:15.947340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:15.964477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:15.964969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:15.968992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:15.973531 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:16.307215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:16.316509 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-02d6772f-6fb2-496f-b4b9-507dcd20f630 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 1.036147 Jul 28 01:14:16.321126 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 35/69] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:15 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:16.352841 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:16.355717 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:16.371338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:16.372387 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:16.375890 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:16.378111 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:16.962968 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:16.970815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-57ee1177-a58e-4afd-9e88-d1ac0092887a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.634498 Jul 28 01:14:16.971484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 36/70] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:16 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:16.982634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:16.987764 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-716870d0-35ed-4885-8514-4b665b7a0581 req-3d7f688c-9511-49e5-aa4f-38f94066858f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300e3c0c-fb14-4c05-b53a-fe8f0589ac1b", "tag": "a76b2846-749f-47c3-81f3-a7c5328f00ad"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:17.005429 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:17.019073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-716870d0-35ed-4885-8514-4b665b7a0581 req-3d7f688c-9511-49e5-aa4f-38f94066858f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.019523 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-716870d0-35ed-4885-8514-4b665b7a0581 req-3d7f688c-9511-49e5-aa4f-38f94066858f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:17.049010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:17.050211 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d1b4a56e-1e41-44ce-b2a4-4c1502075045 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 1.119373 Jul 28 01:14:17.064658 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 35/71] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:15 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:17.085036 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-716870d0-35ed-4885-8514-4b665b7a0581 req-3d7f688c-9511-49e5-aa4f-38f94066858f service nova] Creating event network-changed:a76b2846-749f-47c3-81f3-a7c5328f00ad for instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b on hv-cinder-81558 Jul 28 01:14:17.085843 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-716870d0-35ed-4885-8514-4b665b7a0581 req-3d7f688c-9511-49e5-aa4f-38f94066858f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117958) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 01:14:17.087196 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13ea254b-d081-4057-a0a6-e162f6125985 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.087819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13ea254b-d081-4057-a0a6-e162f6125985 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:17.088753 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13ea254b-d081-4057-a0a6-e162f6125985 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.089328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13ea254b-d081-4057-a0a6-e162f6125985 None None] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:17.099967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.compute.rpcapi [None req-13ea254b-d081-4057-a0a6-e162f6125985 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 01:14:17.100909 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13ea254b-d081-4057-a0a6-e162f6125985 None None] Releasing lock "compute-rpcapi-router" {{(pid=117958) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 01:14:17.121693 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-13ea254b-d081-4057-a0a6-e162f6125985 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144723 Jul 28 01:14:17.125673 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 37/72] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:17.343648 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:17.344305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:17.359514 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.360326 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:17.361251 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.361906 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:17.673684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:17.682697 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5c65cdc3-f89a-4cfc-aceb-6b7610f7328c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.344336 Jul 28 01:14:17.683648 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 36/73] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:17 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:17.816871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-23d9686e-eebf-4bf8-be7b-5f97c2f95598 req-d39fc6fd-1931-4a3b-982a-c345b95da4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26acfa5-94f2-4d1d-8bfd-9f82e73861f8", "name": "network-vif-plugged", "status": "completed", "tag": "77e6a437-69fc-4d47-b75b-cc39937c21bd"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:17.832791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-23d9686e-eebf-4bf8-be7b-5f97c2f95598 req-d39fc6fd-1931-4a3b-982a-c345b95da4ef service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.833594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-23d9686e-eebf-4bf8-be7b-5f97c2f95598 req-d39fc6fd-1931-4a3b-982a-c345b95da4ef service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:17.846528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-23d9686e-eebf-4bf8-be7b-5f97c2f95598 req-d39fc6fd-1931-4a3b-982a-c345b95da4ef service nova] Creating event network-vif-plugged:77e6a437-69fc-4d47-b75b-cc39937c21bd for instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 on hv-cinder-81558 Jul 28 01:14:17.856973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-23d9686e-eebf-4bf8-be7b-5f97c2f95598 req-d39fc6fd-1931-4a3b-982a-c345b95da4ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046707 Jul 28 01:14:17.857184 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-aac17f68-1752-4bb6-a0c5-c8301a444a7c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2636e6f1-20b7-45ac-bd62-5fe5dd23518c"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:17.859650 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 38/74] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:17.867527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-aac17f68-1752-4bb6-a0c5-c8301a444a7c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:17.882299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aac17f68-1752-4bb6-a0c5-c8301a444a7c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.883505 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aac17f68-1752-4bb6-a0c5-c8301a444a7c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:17.885374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aac17f68-1752-4bb6-a0c5-c8301a444a7c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:17.889152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aac17f68-1752-4bb6-a0c5-c8301a444a7c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:18.009157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:18.016916 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:18.045605 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:18.046769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:18.048492 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:18.050194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:18.613239 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-aac17f68-1752-4bb6-a0c5-c8301a444a7c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "POST /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763293 Jul 28 01:14:18.619289 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 37/75] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:14:17 2022] POST /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:18.623773 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:18.625380 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:18.639250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:18.639951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:18.641277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:18.641863 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:18.650820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:18.661809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a5279b94-0bdd-4d14-97e7-cf2304cddfe0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.669705 Jul 28 01:14:18.663163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 39/76] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:17 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:18.702906 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:18.703444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:18.713073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:18.713823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:18.718279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:18.718922 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:18.998563 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:19.018664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:19.022266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:19.024586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2ab050cc-f1bf-42d7-9bad-357f4bff72f6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.408726 Jul 28 01:14:19.025813 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 38/77] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:18 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:19.075291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:19.084205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4539233b-aab2-408d-9965-55e89f1eff5d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.385141 Jul 28 01:14:19.101149 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 40/78] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:18 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:19.686575 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:19.687461 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:19.701474 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:19.702101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:19.703081 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:19.703687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:19.915735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:19.930232 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5e44f040-07f4-429a-be00-71b9a7b2b531 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.249978 Jul 28 01:14:19.931493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 39/79] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:19 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:19.964309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-5812912b-df81-46cf-97d0-41350a326358 req-af536800-30df-4c60-b466-27b06472cc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f9d31b-737a-452f-b047-b6be2bea377b", "name": "network-vif-plugged", "status": "completed", "tag": "b7d3de87-244d-4779-a3e5-9f83c3f0ed25"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:19.974744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=20 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:19.979440 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5812912b-df81-46cf-97d0-41350a326358 req-af536800-30df-4c60-b466-27b06472cc07 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:19.979877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5812912b-df81-46cf-97d0-41350a326358 req-af536800-30df-4c60-b466-27b06472cc07 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:19.993839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-5812912b-df81-46cf-97d0-41350a326358 req-af536800-30df-4c60-b466-27b06472cc07 service nova] Creating event network-vif-plugged:b7d3de87-244d-4779-a3e5-9f83c3f0ed25 for instance 86f9d31b-737a-452f-b047-b6be2bea377b on hv-cinder-81558 Jul 28 01:14:20.002654 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-5812912b-df81-46cf-97d0-41350a326358 req-af536800-30df-4c60-b466-27b06472cc07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051675 Jul 28 01:14:20.011270 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 41/80] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:20.065318 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:20.065946 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:20.072965 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:20.073332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:20.074106 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:20.074704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:20.116918 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:20.116918 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:20.117642 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:20.118352 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:20.119282 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:20.119715 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:20.424284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:20.433488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:20.433659 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:20.435019 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:20.436180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1e70d010-88e1-4fa2-b74a-ad77068adc42 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.375109 Jul 28 01:14:20.436944 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 40/81] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:20 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:20.443296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-424bd2e2-b085-4baf-8edc-3c5e30173e87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.338191 Jul 28 01:14:20.443966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 42/82] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:20 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:20.970371 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:20.971010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:21.002964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:21.003591 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:21.004520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:21.005490 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:21.252795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:21.273887 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-be9c643c-69a7-4677-929d-fe8544f91ad3 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.309810 Jul 28 01:14:21.275094 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 41/83] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:20 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:21.465881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:21.467021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:21.468730 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:21.469356 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:21.480365 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:21.481083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:21.482466 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:21.483094 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:21.483266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:21.483760 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:21.484817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:21.485597 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:21.759048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:21.772400 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-986d40ba-cced-4972-9067-dffd9f49c619 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.309292 Jul 28 01:14:21.773690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 42/84] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:21 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:21.798925 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:21.810283 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:21.812274 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:21.813685 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-acc3611d-3823-4c0e-ba03-ee8e41f4732b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.355542 Jul 28 01:14:21.814446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 43/85] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:21 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:22.300860 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:22.301538 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:22.309651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:22.310117 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:22.311065 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:22.311701 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:22.510214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:22.522450 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-810e8f53-7add-4c77-8d70-9af9f1386b5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1322 microversion: 2.1 time: 0.227781 Jul 28 01:14:22.523884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 43/86] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:22 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:22.795541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:22.796389 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:22.810261 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:22.812222 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:22.814142 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:22.816032 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:22.839418 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:22.840344 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:22.848487 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:22.849497 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:22.851336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:22.852293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:23.147640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:23.161565 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b724232-5fdf-4634-9fc3-fd5cda71f012 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.369208 Jul 28 01:14:23.178290 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 44/87] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:22 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:23.301395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:23.318790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:23.322047 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:23.324288 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-10b575b9-78f0-4ab6-8b0f-ea99056776a5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.490393 Jul 28 01:14:23.325760 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 44/88] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:22 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:14:23.549358 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:23.550093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:23.561173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:23.561907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:23.562869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:23.564966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:23.751421 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:23.760542 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-147af9b3-92bf-4714-b42f-e8820ebe3fe6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1515 microversion: 2.1 time: 0.215200 Jul 28 01:14:23.776729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 45/89] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:23 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:23.792492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:23.797641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:23.824594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:23.825165 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:23.826482 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:23.827054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:23.857846 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lazy-loading 'flavor' on Instance uuid 86f9d31b-737a-452f-b047-b6be2bea377b {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:14:24.044057 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-12f4cfe3-8247-4382-b149-b470c874283f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b/action" status: 200 len: 32 microversion: 2.1 time: 0.260608 Jul 28 01:14:24.045971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 45/90] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:14:23 2022] POST /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:14:24.064018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:24.064018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:24.084026 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:24.084760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:24.086193 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:24.087270 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:24.184067 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:24.185153 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:24.197172 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:24.199915 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:24.202731 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:24.204871 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:24.694981 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:24.708418 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-19169f65-56da-4e7e-a3b4-ed6afddca4b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.525200 Jul 28 01:14:24.725536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 46/91] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:24 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:24.730817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:24.738993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:24.756614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:24.758328 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:24.762726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:24.764061 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:24.840434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:24.889313 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d16aa12-1563-4039-8595-96e5dd1c1518 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.831128 Jul 28 01:14:24.891314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 46/92] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:24 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:24.901346 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-b3e411f2-5100-41cd-9d5a-fdcfa6ec4532 req-90f23754-fbb5-4d90-8151-526e64f459c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3c75a9-eb23-4978-bb95-53fe1e079f36", "name": "network-vif-plugged", "status": "completed", "tag": "5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:24.927547 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-b3e411f2-5100-41cd-9d5a-fdcfa6ec4532 req-90f23754-fbb5-4d90-8151-526e64f459c7 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:24.928248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-b3e411f2-5100-41cd-9d5a-fdcfa6ec4532 req-90f23754-fbb5-4d90-8151-526e64f459c7 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:24.961315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-b3e411f2-5100-41cd-9d5a-fdcfa6ec4532 req-90f23754-fbb5-4d90-8151-526e64f459c7 service nova] Creating event network-vif-plugged:5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef for instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 on hv-cinder-81558 Jul 28 01:14:24.974721 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-b3e411f2-5100-41cd-9d5a-fdcfa6ec4532 req-90f23754-fbb5-4d90-8151-526e64f459c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081860 Jul 28 01:14:24.979234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 47/93] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:25.244871 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:25.247935 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:25.257893 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:25.278444 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:25.279655 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-94aaac4f-1cd4-49cf-9207-ab9d2dfd8c82 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.552928 Jul 28 01:14:25.280223 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 47/94] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:24 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:25.729219 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:25.730640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:25.739319 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:25.739950 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:25.740908 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:25.741421 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:25.918904 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:25.920731 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:25.949423 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:25.950495 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:25.950982 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:25.951903 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:25.952343 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:25.958772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4b88b18c-0b85-41a3-b216-bd4f0ef325b2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.233873 Jul 28 01:14:25.960176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 48/95] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:25 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:26.135407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:26.145928 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2f892ae4-0c60-4ac6-94ca-cc6c43138c25 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.236148 Jul 28 01:14:26.146333 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 48/96] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:25 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:26.301656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:26.302258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:26.308491 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:26.308941 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:26.309709 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:26.310138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:26.461775 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:26.465897 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:26.484094 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:26.487182 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:26.489175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9758a2af-9299-4728-a45f-883875c3cd36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.191377 Jul 28 01:14:26.490225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 49/97] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:26 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:26.979579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:26.980308 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:26.993538 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:26.994138 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:26.995058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:26.997208 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:27.035304 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-aa1d2a17-d0c5-411a-99bd-5a26590e95d3 req-ec76a270-3222-4c37-a863-5516ce56fd7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300e3c0c-fb14-4c05-b53a-fe8f0589ac1b", "name": "network-vif-plugged", "status": "completed", "tag": "a76b2846-749f-47c3-81f3-a7c5328f00ad"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:27.055231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-aa1d2a17-d0c5-411a-99bd-5a26590e95d3 req-ec76a270-3222-4c37-a863-5516ce56fd7f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:27.055872 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-aa1d2a17-d0c5-411a-99bd-5a26590e95d3 req-ec76a270-3222-4c37-a863-5516ce56fd7f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:27.086812 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-aa1d2a17-d0c5-411a-99bd-5a26590e95d3 req-ec76a270-3222-4c37-a863-5516ce56fd7f service nova] Creating event network-vif-plugged:a76b2846-749f-47c3-81f3-a7c5328f00ad for instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b on hv-cinder-81558 Jul 28 01:14:27.092412 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-aa1d2a17-d0c5-411a-99bd-5a26590e95d3 req-ec76a270-3222-4c37-a863-5516ce56fd7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060797 Jul 28 01:14:27.093192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 50/98] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:14:27.169431 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:27.169431 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:27.175866 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:27.178816 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:27.179288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:27.180131 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:27.180560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:27.193695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:27.203421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d360ea07-5393-4f1f-87c7-a46acf37dd04 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.228485 Jul 28 01:14:27.205397 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 49/99] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:26 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:27.352780 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:27.362339 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7e5e514e-e2ea-42f3-97d6-85d80ce18d38 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.198357 Jul 28 01:14:27.363928 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 51/100] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:27 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:27.513780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:27.514469 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:27.520842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:27.521831 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:27.522809 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:27.523472 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:27.694673 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:27.710290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:27.711803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:27.713670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-11a784f0-1481-4496-8ecf-f659d8ee5f47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.203070 Jul 28 01:14:27.714611 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 50/101] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:27 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:28.225435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:28.226128 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:28.232567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:28.233011 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:28.234371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:28.234810 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:28.387471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:28.388312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:28.401834 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:28.402287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:28.403112 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:28.403550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:28.435654 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:28.449166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5606e414-f546-4069-b28e-1177bef325d5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1362 microversion: 2.1 time: 0.227575 Jul 28 01:14:28.456266 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 52/102] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:28 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:28.677070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:28.694387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-456afe49-8d98-4443-a130-de041b2caae1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.312735 Jul 28 01:14:28.697260 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 51/103] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:28 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:28.737626 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:28.738242 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:28.746819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:28.747873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:28.749166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:28.749759 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:29.037635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:29.047190 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:29.052723 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:29.055992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ad2f4b66-5c6f-4ee7-9ad6-d2db37d58c19 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.323091 Jul 28 01:14:29.057295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 53/104] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:28 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:29.480024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:29.482284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:29.487443 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:29.493242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:29.493689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:29.495027 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:29.495506 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:29.691207 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:29.701111 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-26c5fb04-40bd-4878-8dc1-fab6191e3f35 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1549 microversion: 2.1 time: 0.232869 Jul 28 01:14:29.702443 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 52/105] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:29 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1549 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:29.720686 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:29.722098 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:29.733692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:29.738712 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:29.739966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:29.740798 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:29.743748 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-bac6f704-f27b-4456-a0ee-16fb9ac47849 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:29.744450 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-bac6f704-f27b-4456-a0ee-16fb9ac47849 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:29.762210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bac6f704-f27b-4456-a0ee-16fb9ac47849 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:29.764884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bac6f704-f27b-4456-a0ee-16fb9ac47849 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:29.769384 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bac6f704-f27b-4456-a0ee-16fb9ac47849 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:29.771149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bac6f704-f27b-4456-a0ee-16fb9ac47849 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:30.016199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-bac6f704-f27b-4456-a0ee-16fb9ac47849 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.277720 Jul 28 01:14:30.024859 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 53/106] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:14:29 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:30.081589 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:30.082445 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:30.103918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:30.105008 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:30.109672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:30.113520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:30.159553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:30.173322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4660f03f-5fb6-4886-925e-a1d19032fe93 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.457074 Jul 28 01:14:30.177027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 54/107] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:29 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:30.444328 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:30.454176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:30.455737 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:30.457164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7df3c8b0-0057-418e-b230-7fbedb1ce592 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.381627 Jul 28 01:14:30.457880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 54/108] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:30 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:14:31.112710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:31.113214 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:31.115188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:31.120820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.121490 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.122417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.123055 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.152299 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:14:31.200493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:31.201116 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:31.243203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.243669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.244466 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.244907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.410151 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e1a867a0-b8de-4721-b119-9512e94d72b0 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 204 len: 0 microversion: 2.1 time: 0.301003 Jul 28 01:14:31.410750 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 55/109] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:14:31 2022] DELETE /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 01:14:31.419939 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:31.420653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:31.430921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.431681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.432666 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.433266 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.699890 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:31.723734 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e0bf603d-58b8-4f04-862f-75290689d3f3 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1553 microversion: 2.1 time: 0.303338 Jul 28 01:14:31.724564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 56/110] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:31 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:14:31.727118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:31.735089 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-504a6c23-d7a2-4914-93a5-b005c52d3214 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.542176 Jul 28 01:14:31.738673 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 55/111] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:31 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:31.743103 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:31.746593 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:31.766741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.767718 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.772076 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:31.773447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:31.993280 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:32.002867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:32.005611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:32.007166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d0e43edf-bf1f-4e26-abed-8ec42fb30d4e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1406 microversion: 2.20 time: 0.272606 Jul 28 01:14:32.023288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 57/112] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:31 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:32.661669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-83de5e6c-f393-4b4e-a2e4-8138ff781e7c req-7142d703-84d4-4fe6-9830-512c6d29043f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3c75a9-eb23-4978-bb95-53fe1e079f36", "tag": "5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:32.674237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-83de5e6c-f393-4b4e-a2e4-8138ff781e7c req-7142d703-84d4-4fe6-9830-512c6d29043f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:32.674675 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-83de5e6c-f393-4b4e-a2e4-8138ff781e7c req-7142d703-84d4-4fe6-9830-512c6d29043f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:32.687009 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-83de5e6c-f393-4b4e-a2e4-8138ff781e7c req-7142d703-84d4-4fe6-9830-512c6d29043f service nova] Creating event network-changed:5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef for instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 on hv-cinder-81558 Jul 28 01:14:32.693782 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-83de5e6c-f393-4b4e-a2e4-8138ff781e7c req-7142d703-84d4-4fe6-9830-512c6d29043f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Jul 28 01:14:32.695778 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 56/113] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:32.745460 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:32.746090 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:32.758338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:32.758689 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:32.766827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:32.767549 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:32.775815 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:32.776271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:32.777055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:32.777539 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:32.780743 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:32.781200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:33.165924 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:33.180947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b9400aae-3dc8-4290-aafe-0e4e13cf863d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1553 microversion: 2.1 time: 0.438790 Jul 28 01:14:33.181550 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 58/114] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:32 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1553 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:33.212957 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:33.214100 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:33.235591 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:33.238137 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:33.240861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:33.242080 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:33.242865 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:33.249250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f7790895-bf91-448c-b2c7-98857a5c4759 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.485901 Jul 28 01:14:33.250559 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 57/115] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:32 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:33.418127 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:33.429484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:33.435738 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:33.437947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9b7547b5-02fe-40ec-83d8-431189f5842e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1599 microversion: 2.20 time: 0.246876 Jul 28 01:14:33.440087 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 59/116] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:14:33 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1599 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:14:33.466161 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7c897bd2-7e0a-48da-8ae0-bcd5fa70fb4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:33.468047 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7c897bd2-7e0a-48da-8ae0-bcd5fa70fb4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:33.477975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c897bd2-7e0a-48da-8ae0-bcd5fa70fb4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:33.478748 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c897bd2-7e0a-48da-8ae0-bcd5fa70fb4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:33.480496 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c897bd2-7e0a-48da-8ae0-bcd5fa70fb4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:33.481179 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c897bd2-7e0a-48da-8ae0-bcd5fa70fb4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:33.647236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7c897bd2-7e0a-48da-8ae0-bcd5fa70fb4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.187141 Jul 28 01:14:33.649345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 58/117] 10.222.0.17 () {60 vars in 1316 bytes} [Thu Jul 28 01:14:33 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:14:34.204684 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:34.205855 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:34.218405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:34.224054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:34.225158 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:34.225945 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:34.274343 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:34.276228 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:34.289006 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:34.295386 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:34.296602 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:34.297265 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:35.151354 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:35.168224 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e2d2ccc0-80b4-41f8-8d3b-2511e840bf49 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.898405 Jul 28 01:14:35.169067 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 59/118] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:34 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:35.310139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:35.327916 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2a1fd44a-d01d-4ddb-857b-8873d639545d tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1553 microversion: 2.1 time: 1.128306 Jul 28 01:14:35.328512 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 60/119] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:34 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1553 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:35.613481 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-e36ce845-01a6-4576-be60-6fd6112ac513 req-2184a22c-670b-4906-9dea-057fd727f659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae47659-3cd8-4380-a4bf-e8ed0066a9a0", "name": "network-vif-deleted", "tag": "9f1daf0a-6008-4ac7-9309-150096a05481"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:35.625692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-e36ce845-01a6-4576-be60-6fd6112ac513 req-2184a22c-670b-4906-9dea-057fd727f659 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:35.626136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-e36ce845-01a6-4576-be60-6fd6112ac513 req-2184a22c-670b-4906-9dea-057fd727f659 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:35.657172 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-e36ce845-01a6-4576-be60-6fd6112ac513 req-2184a22c-670b-4906-9dea-057fd727f659 service nova] Creating event network-vif-deleted:9f1daf0a-6008-4ac7-9309-150096a05481 for instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 on hv-cinder-81558 Jul 28 01:14:35.670172 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-e36ce845-01a6-4576-be60-6fd6112ac513 req-2184a22c-670b-4906-9dea-057fd727f659 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054588 Jul 28 01:14:35.671489 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 60/120] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:36.189816 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:36.190605 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:36.199275 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:36.201834 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:36.204358 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:36.205832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:36.351974 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:36.353025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:36.370528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:36.372143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:36.380576 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:36.381458 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:36.479736 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:36.493734 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:36.497493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lazy-loading 'fault' on Instance uuid 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:14:36.620731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:36.628042 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b16be4f85b440a9e3afea73ffc7871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b3087180c642a78010ed1382cf1868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:36.635647 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-366930f7-f977-4b28-9610-ac4e2eb6a1d6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.449734 Jul 28 01:14:36.642769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 61/121] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:36 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:36.644700 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-534c6ffd-5615-4f5a-8993-75ffde91224c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 200 len: 1350 microversion: 2.1 time: 0.299278 Jul 28 01:14:36.655547 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 61/122] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:36 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 1350 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:37.668183 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:37.668535 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:37.668886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:37.670136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:37.683516 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:37.683977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:37.685702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:37.685992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:37.686127 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:37.687928 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:37.689975 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:37.691243 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:37.704636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] HTTP exception thrown: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Request method failure captured: Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 HTTP/1.1 Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eK9nrcwJnvbhL3UdDyr7IyC8pHh4tU6gSuK_3ouHjLktcsO1pyhLoyqDbfJFbQFimd9VZjij1p1qP-BEUnc5Xe31uwO1a9_gRoXm8shjpzbhUJPPJm44DPXJvHq7tmyAO5Olt9wmYW8sNIqPgpJNePcjjGIlYS68YhdfAtdBZ_hbsY Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:14:37.710669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c8b3087180c642a78010ed1382cf1868", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 84b16be4f85b440a9e3afea73ffc7871 Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:37.712157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '9ae47659-3cd8-4380-a4bf-e8ed0066a9a0'} Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:14:37.712828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:37.714312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:37.716921 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Returning 404 to user: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:14:37.718400 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e4d44435-9fce-4101-9808-6db6f055bc0b tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 404 len: 111 microversion: 2.1 time: 0.053592 Jul 28 01:14:37.719834 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 62/123] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:37 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:14:37.725895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-d37593d8-9051-4f31-a7b7-e7008f96a4ef req-54ed86fa-a24e-4251-a45e-557e5107bdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300e3c0c-fb14-4c05-b53a-fe8f0589ac1b", "tag": "a76b2846-749f-47c3-81f3-a7c5328f00ad"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:37.747282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d37593d8-9051-4f31-a7b7-e7008f96a4ef req-54ed86fa-a24e-4251-a45e-557e5107bdb9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:37.749435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d37593d8-9051-4f31-a7b7-e7008f96a4ef req-54ed86fa-a24e-4251-a45e-557e5107bdb9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:37.791570 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-d37593d8-9051-4f31-a7b7-e7008f96a4ef req-54ed86fa-a24e-4251-a45e-557e5107bdb9 service nova] Creating event network-changed:a76b2846-749f-47c3-81f3-a7c5328f00ad for instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b on hv-cinder-81558 Jul 28 01:14:37.791570 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-d37593d8-9051-4f31-a7b7-e7008f96a4ef req-54ed86fa-a24e-4251-a45e-557e5107bdb9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067755 Jul 28 01:14:37.791570 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 63/124] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:38.159239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:38.172785 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c4cb454f-f19e-43cb-a21a-b39e9c9e27cc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.510904 Jul 28 01:14:38.189809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 62/125] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:37 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:38.302130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:38.305067 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:38.322452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:38.325179 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:38.328433 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:38.346829 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:38.405575 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] HTTP exception thrown: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Request method failure captured: Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0/os-volume_attachments HTTP/1.1 Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eK9nrcwJnvbhL3UdDyr7IyC8pHh4tU6gSuK_3ouHjLktcsO1pyhLoyqDbfJFbQFimd9VZjij1p1qP-BEUnc5Xe31uwO1a9_gRoXm8shjpzbhUJPPJm44DPXJvHq7tmyAO5Olt9wmYW8sNIqPgpJNePcjjGIlYS68YhdfAtdBZ_hbsY Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:14:38.410053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c8b3087180c642a78010ed1382cf1868", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 84b16be4f85b440a9e3afea73ffc7871 Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:38.412528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'server_id': '9ae47659-3cd8-4380-a4bf-e8ed0066a9a0'} Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:14:38.413169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:38.414199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:38.420678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Returning 404 to user: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:14:38.423099 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e64d33d1-329e-44a8-9d51-ef7073cf623c tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.127822 Jul 28 01:14:38.428226 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 64/126] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:14:38 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0/os-volume_attachments => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:14:39.211767 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:39.212509 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:39.219021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:39.219469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:39.220401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:39.220853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:39.388500 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:39.398694 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c5ce358-1f51-49b5-85ba-fc6ed0fd5392 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.190734 Jul 28 01:14:39.410869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 63/127] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:39 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:40.433005 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:40.433627 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:40.442526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:40.443095 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:40.443865 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:40.444305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:40.591595 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:40.600154 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-68582bec-a9ee-49f3-a8b0-c7cabc6aa7f0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.177339 Jul 28 01:14:40.600728 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 65/128] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:40 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:41.621133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:41.622600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:41.629403 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:41.631105 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:41.632487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:41.633198 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:41.785540 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:41.796173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-087e59e7-f4b3-444c-9916-e46e5c0fe87b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.178926 Jul 28 01:14:41.796858 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 64/129] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:41 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:41.838225 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:41.838809 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:41.845623 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:41.846075 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:41.846867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:41.847312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:41.861272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] HTTP exception thrown: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Request method failure captured: Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: DELETE /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 HTTP/1.1 Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eK9nrcwJnvbhL3UdDyr7IyC8pHh4tU6gSuK_3ouHjLktcsO1pyhLoyqDbfJFbQFimd9VZjij1p1qP-BEUnc5Xe31uwO1a9_gRoXm8shjpzbhUJPPJm44DPXJvHq7tmyAO5Olt9wmYW8sNIqPgpJNePcjjGIlYS68YhdfAtdBZ_hbsY Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:14:41.862918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c8b3087180c642a78010ed1382cf1868", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 84b16be4f85b440a9e3afea73ffc7871 Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '9ae47659-3cd8-4380-a4bf-e8ed0066a9a0'} Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:14:41.865171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.866396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.867576 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Returning 404 to user: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:14:41.867576 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3d674ecb-72f7-42ad-b224-dc045896ad86 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 404 len: 111 microversion: 2.1 time: 0.032101 Jul 28 01:14:41.867713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 66/130] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:14:41 2022] DELETE /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:14:41.880765 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:41.881407 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] [instance: 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:41.887344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:41.890791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:41.890791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:41.890791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:41.903465 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] HTTP exception thrown: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Request method failure captured: Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 HTTP/1.1 Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eK9nrcwJnvbhL3UdDyr7IyC8pHh4tU6gSuK_3ouHjLktcsO1pyhLoyqDbfJFbQFimd9VZjij1p1qP-BEUnc5Xe31uwO1a9_gRoXm8shjpzbhUJPPJm44DPXJvHq7tmyAO5Olt9wmYW8sNIqPgpJNePcjjGIlYS68YhdfAtdBZ_hbsY Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:14:41.908089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c8b3087180c642a78010ed1382cf1868", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c8b3087180c642a78010ed1382cf1868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: c8b3087180c642a78010ed1382cf1868 Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-DeleteServersTestJSON-1747614598 Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 84b16be4f85b440a9e3afea73ffc7871 Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-DeleteServersTestJSON-1747614598-project Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.909435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '9ae47659-3cd8-4380-a4bf-e8ed0066a9a0'} Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:14:41.910408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. Jul 28 01:14:41.911683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:14:41.913077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] Returning 404 to user: Instance 9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:14:41.913077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7913d43f-4895-470a-b402-ac04b4d15f50 tempest-DeleteServersTestJSON-1747614598 tempest-DeleteServersTestJSON-1747614598-project] 10.222.0.17 "GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0" status: 404 len: 111 microversion: 2.1 time: 0.037090 Jul 28 01:14:41.913077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 65/131] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:41 2022] GET /compute/v2.1/servers/9ae47659-3cd8-4380-a4bf-e8ed0066a9a0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:14:42.817975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:42.819124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:42.826588 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:42.827603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:42.828548 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:42.828942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:43.059575 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:43.068367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-843b27b2-3b21-4a10-a7da-df7112854f19 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.254027 Jul 28 01:14:43.069347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 67/132] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:42 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:44.089701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:44.090999 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:44.097413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:44.098149 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:44.099050 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:44.099635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:44.104261 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:44.325624 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:44.333912 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-484b8880-b2b5-439e-b63c-0414827a1665 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.248062 Jul 28 01:14:44.334819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 66/133] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:44 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:45.355555 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:45.356091 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:45.367969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:45.368684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:45.369636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:45.370221 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:45.652592 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:45.655059 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=100 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:45.662360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9b91f31e-2719-4319-9120-5a946cc39961 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.310925 Jul 28 01:14:45.662966 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 68/134] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:45 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:46.683572 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:46.684192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:46.690564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:46.691387 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:46.692160 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:46.692603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:46.826186 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:46.833748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ab6f63ac-dc5f-4f7b-9d20-473f4cb74edd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.154115 Jul 28 01:14:46.834322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 67/135] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:46 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:47.290563 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1e9da9c3-81fe-4460-83a8-a87149851600 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Action: 'create', calling method: .version_select at 0x7ff71c7b84c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-478388367"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:47.619990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1e9da9c3-81fe-4460-83a8-a87149851600 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.454278 Jul 28 01:14:47.620629 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 69/136] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jul 28 01:14:47 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 456 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 01:14:47.633868 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b17bb305-4649-42c6-9f32-2fd7bd3faa80 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7d1d30>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:47.686128 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b17bb305-4649-42c6-9f32-2fd7bd3faa80 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.056505 Jul 28 01:14:47.686708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 68/137] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:14:47 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:47.858875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:47.859513 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:47.868453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:47.868901 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:47.873973 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:47.875576 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:48.026120 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:48.034180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b09b62ec-023b-46e7-81e5-fbbc9f6f3509 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.182384 Jul 28 01:14:48.034773 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 70/138] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:47 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:48.700852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8a77aaba-a955-4d51-843a-14e03bc11d9e tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4b80>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:48.750673 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8a77aaba-a955-4d51-843a-14e03bc11d9e tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.053664 Jul 28 01:14:48.751293 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 69/139] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:14:48 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:49.056325 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:49.056933 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:49.065121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:49.065569 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:49.066340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:49.066780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:49.200232 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:49.208359 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9fa90cad-e326-41ba-b2e1-37229cd21f5a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.156133 Jul 28 01:14:49.208906 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 71/140] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:49 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:49.767544 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-90cb7f31-7133-4da5-a675-403e31e1b403 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4af0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:49.857647 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-90cb7f31-7133-4da5-a675-403e31e1b403 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 345 microversion: 2.1 time: 0.095373 Jul 28 01:14:49.865888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 70/141] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:14:49 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:49.872671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ea45142a-39e5-4f3c-b88e-2dd4a9ef78eb tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Action: 'create', calling method: .version_select at 0x7ff71c7c0040>, body: {"snapshot": {"volume_id": "589273f1-c7b6-4f5f-bf06-b6042ae9813a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1935157126"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:14:50.052767 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ea45142a-39e5-4f3c-b88e-2dd4a9ef78eb tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.184892 Jul 28 01:14:50.053365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 72/142] 10.222.0.17 () {60 vars in 1162 bytes} [Thu Jul 28 01:14:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:14:50.066052 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1e813f9a-4a2e-428c-9104-3dbe74f7ed72 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7fc940>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:50.099898 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1e813f9a-4a2e-428c-9104-3dbe74f7ed72 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.037761 Jul 28 01:14:50.100798 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 71/143] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:50 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:50.112984 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f3703702-5519-428f-9f8e-31069163313e tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7b9040>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:50.143769 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f3703702-5519-428f-9f8e-31069163313e tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035103 Jul 28 01:14:50.144504 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 73/144] 10.222.0.17 () {58 vars in 1140 bytes} [Thu Jul 28 01:14:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:50.155761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-55ff4173-1b70-4328-bfab-8bc1b48480d7 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7d1f70>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:50.186588 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-55ff4173-1b70-4328-bfab-8bc1b48480d7 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.034575 Jul 28 01:14:50.187280 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 72/145] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:50 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:50.233513 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:50.234513 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:50.248337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:50.248793 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:50.249548 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:50.249986 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:50.381905 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:50.393096 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-aad73fcc-8404-4987-bfbe-8ee483f7e747 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.167133 Jul 28 01:14:50.393875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 74/146] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:50 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:51.199053 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85fa99ab-300a-4a73-a583-463b12e284c9 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c8e1f70>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:51.231403 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85fa99ab-300a-4a73-a583-463b12e284c9 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.036317 Jul 28 01:14:51.231964 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 73/147] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:51 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:51.415870 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:51.416452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:51.423556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:51.424004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:51.424771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:51.425203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:51.558864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:51.566496 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-96bf067a-9f43-4ccf-84bf-ac88e1002f3e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.155573 Jul 28 01:14:51.567143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 75/148] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:51 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:52.250802 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0dd22b61-662d-4d4c-b9d3-968cdfdbea3e tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4af0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:52.284602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0dd22b61-662d-4d4c-b9d3-968cdfdbea3e tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.040503 Jul 28 01:14:52.285185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 74/149] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:52 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:52.588339 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:52.588884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:52.596005 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:52.596457 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:52.597223 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:52.597655 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:52.739518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:52.747555 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e520589f-ebba-4b9b-8d20-a79b0c40a41f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.163328 Jul 28 01:14:52.748140 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 76/150] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:52 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:53.297949 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c2e336a-f8dc-451b-be5d-b35410648d0d tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4b80>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:53.328388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c2e336a-f8dc-451b-be5d-b35410648d0d tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.034369 Jul 28 01:14:53.328961 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 75/151] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:53 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:53.772396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:53.773332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:53.784493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:53.785241 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:53.786507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:53.787300 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:53.926692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:53.935806 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b268c6dc-acc8-4973-89c6-b486a903eee2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.169739 Jul 28 01:14:53.936592 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 77/152] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:53 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:54.342504 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-24ff6221-bc25-4c51-b582-361f7cbf2fd0 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71da4adc0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:54.376454 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-24ff6221-bc25-4c51-b582-361f7cbf2fd0 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.037794 Jul 28 01:14:54.377255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 76/153] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:54 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:54.960536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:54.961119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:54.968100 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:54.968549 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:54.969317 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:54.969752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:55.107397 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:55.115332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5d9f4da2-204e-43e2-b022-bc21bb694905 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.161072 Jul 28 01:14:55.115905 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 78/154] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:54 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:55.393953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3e78fce0-815b-454a-991f-96c6e4f3c5c6 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7d1ee0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:55.431946 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3e78fce0-815b-454a-991f-96c6e4f3c5c6 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.043257 Jul 28 01:14:55.432652 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 77/155] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:55 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:56.136691 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:56.137314 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:56.144263 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:56.144716 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:56.145486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:56.145920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:56.283640 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:56.295643 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e0c92cc1-fe2a-411b-80e0-fec47ffe9195 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.162859 Jul 28 01:14:56.296431 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 79/156] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:56 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:56.448313 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a913e01d-1874-4e98-8151-9305dc0742ad tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4550>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:56.478613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a913e01d-1874-4e98-8151-9305dc0742ad tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.034312 Jul 28 01:14:56.479330 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 78/157] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:56 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:14:57.321561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:57.321561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:57.327803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:57.328437 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:57.329627 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:57.330230 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:57.489774 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:57.490328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=11 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:57.496400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3564f0e9-570b-477c-a748-3d8c66186211 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c91aa60>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:57.500491 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:57.513628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-33823bc7-e222-4ad9-9b34-e63749e0fe83 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.198271 Jul 28 01:14:57.514550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 80/158] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:57 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:57.533983 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3564f0e9-570b-477c-a748-3d8c66186211 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.045735 Jul 28 01:14:57.534551 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 79/159] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:57 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:58.536439 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:58.537202 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:58.544350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:58.544790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:58.545740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:58.546301 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:58.548367 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3e9127b-7136-4e47-8777-f8bdbb5e7885 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c8e1280>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:58.580399 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b3e9127b-7136-4e47-8777-f8bdbb5e7885 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.037324 Jul 28 01:14:58.580971 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 80/160] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:58 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:14:58.689853 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:58.701293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-bd047bac-d7e5-4ff6-95be-9827492226c6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.168590 Jul 28 01:14:58.702082 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 81/161] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:58 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:14:59.597522 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6640134c-262f-4907-a807-b4d048cb26d6 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4dc0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:59.632876 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6640134c-262f-4907-a807-b4d048cb26d6 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.039057 Jul 28 01:14:59.633834 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 81/162] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:14:59 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:14:59.726132 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:14:59.726728 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:14:59.729305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=56 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:14:59.735108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:59.735560 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:59.736494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:14:59.736907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:14:59.891811 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:14:59.904174 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f33fe13f-bf83-42a9-b00d-bdf51ea3c979 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.181739 Jul 28 01:14:59.905031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 82/163] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:14:59 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:00.648275 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-04177a77-8568-43e2-9479-548eed5c5866 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4550>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:00.688288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-04177a77-8568-43e2-9479-548eed5c5866 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 288 microversion: 2.1 time: 0.043820 Jul 28 01:15:00.688864 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 82/164] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:15:00 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 288 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:00.700048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cb5d5e9a-1928-4aa3-97e0-9e478f98ad09 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7b8af0>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:00.771753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-cb5d5e9a-1928-4aa3-97e0-9e478f98ad09 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 202 len: 0 microversion: 2.1 time: 0.075446 Jul 28 01:15:00.772352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 83/165] 10.222.0.17 () {58 vars in 1254 bytes} [Thu Jul 28 01:15:00 2022] DELETE /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:15:00.780694 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d88923ad-3b18-453b-aff8-2e118afb2726 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f40d0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:00.810704 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d88923ad-3b18-453b-aff8-2e118afb2726 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.033744 Jul 28 01:15:00.811306 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 83/166] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:15:00 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:00.926822 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:00.927461 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:00.934306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:00.934806 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:00.935613 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:00.936083 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:01.071898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:01.079969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ff1c1e46-cc73-4f2e-8658-cde9c7aac5d1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.157939 Jul 28 01:15:01.080545 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 84/167] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:00 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:01.826071 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-96ae4319-a138-4f1d-ba49-959c3e9c9192 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f43a0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:01.863308 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-96ae4319-a138-4f1d-ba49-959c3e9c9192 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.042698 Jul 28 01:15:01.863880 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 84/168] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:15:01 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:02.101478 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:02.102088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:02.109387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:02.109841 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:02.110616 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:02.111085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:02.256157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:02.268735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ea0e6d8b-3eb9-4c2c-9a6b-de862ac74804 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.171100 Jul 28 01:15:02.269942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 85/169] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:02 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:02.878684 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8dffa5c-65c8-4076-96b2-0146a87070dc tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4e50>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:02.909360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8dffa5c-65c8-4076-96b2-0146a87070dc tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 200 len: 287 microversion: 2.1 time: 0.035885 Jul 28 01:15:02.909932 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 85/170] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:15:02 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:03.293010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:03.293660 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:03.301066 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:03.301518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:03.302331 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:03.302760 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:03.440957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:03.449437 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c6d3081d-a53f-4752-be57-5cb275f201a1 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.160359 Jul 28 01:15:03.464678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 86/171] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:03 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:03.924008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-023778a4-07a2-40d8-b983-0ae4f8fae46f tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71e5071f0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:03.950671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-023778a4-07a2-40d8-b983-0ae4f8fae46f tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] HTTP exception thrown: Snapshot 3c5517a1-4a26-4acf-847b-5c7fa6533686 could not be found. Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-023778a4-07a2-40d8-b983-0ae4f8fae46f tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Request method failure captured: Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 HTTP/1.1 Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eMHDZcQ0M-H3oDUSK8FlArfJQDO0Ucaa3wR2HDXbqzYjMtq7hUrofMfZzD3vj8yeWYBCLfu0edioM1ko_lRErR3wK9t7BGh8iynjS0VqTtH__332pYrv0RZNLHJOAV3ZvdP1NGXRFx0JWNR7Z8k3w-Ug7xs_STtZLfN8x8ELcOr7Ww Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:15:03.952953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_16713d66669a42439081860207e6f6d6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/16713d66669a42439081860207e6f6d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: b9f094e1926c4cc6935762ec1eccdd98 Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Snapshot 3c5517a1-4a26-4acf-847b-5c7fa6533686 could not be found. Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '3c5517a1-4a26-4acf-847b-5c7fa6533686'} Jul 28 01:15:03.954376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3c5517a1-4a26-4acf-847b-5c7fa6533686 could not be found. (HTTP 404) (Request-ID: req-9096acf6-bd01-43ab-8a00-f007134e94ac) Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:03.955303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:15:03.956555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3c5517a1-4a26-4acf-847b-5c7fa6533686 could not be found. Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 01:15:03.958203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3c5517a1-4a26-4acf-847b-5c7fa6533686 could not be found. Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3c5517a1-4a26-4acf-847b-5c7fa6533686 could not be found. Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-023778a4-07a2-40d8-b983-0ae4f8fae46f tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Returning 404 to user: Snapshot 3c5517a1-4a26-4acf-847b-5c7fa6533686 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:15:03.959809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-023778a4-07a2-40d8-b983-0ae4f8fae46f tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686" status: 404 len: 111 microversion: 2.1 time: 0.034555 Jul 28 01:15:03.963730 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c2993bdf-855b-4b6d-b3bd-a0b622822a90 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c76d940>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:03.970379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 86/172] 10.222.0.17 () {58 vars in 1251 bytes} [Thu Jul 28 01:15:03 2022] GET /compute/v2.1/os-snapshots/3c5517a1-4a26-4acf-847b-5c7fa6533686 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:15:04.036587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c2993bdf-855b-4b6d-b3bd-a0b622822a90 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 202 len: 0 microversion: 2.1 time: 0.076641 Jul 28 01:15:04.037160 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:15:03 2022] DELETE /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:15:04.051575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b51175af-caeb-4f7a-b07f-95cfe37b7c39 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4e50>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:04.110960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b51175af-caeb-4f7a-b07f-95cfe37b7c39 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.065975 Jul 28 01:15:04.110960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 87/174] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:04 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:04.476436 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:04.477767 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:04.488151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:04.488980 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:04.490330 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:04.491169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:04.675101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:04.689331 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1d62ee51-b245-41dd-a7c1-659c25040c07 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.220889 Jul 28 01:15:04.689929 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 88/175] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:04 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:05.129674 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85a72717-d18a-4742-84b1-1c374681b56b tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4670>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:05.183937 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85a72717-d18a-4742-84b1-1c374681b56b tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.060119 Jul 28 01:15:05.184805 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 88/176] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:05 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:05.712895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:05.713502 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:05.721033 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:05.721621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:05.726057 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:05.726734 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:05.860966 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:05.868516 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-84d009e2-319a-40a4-9161-fd50d78e7893 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.159921 Jul 28 01:15:05.869083 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 89/177] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:05 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:06.197650 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0cb66596-9a11-4ef0-b1b7-c798e1afe9db tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7d1af0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:06.249848 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0cb66596-9a11-4ef0-b1b7-c798e1afe9db tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.056036 Jul 28 01:15:06.252162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 89/178] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:06 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:06.890964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:06.891529 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:06.898587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:06.899084 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:06.899867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:06.900302 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:06.915858 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=100 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:07.052246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:07.060172 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d5c1b221-82a7-4521-84e6-a81015bc3dd6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.173162 Jul 28 01:15:07.061094 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 90/179] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:06 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:07.266634 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c927b9a3-d6eb-4f3d-9569-12e74a23ef32 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c8f1280>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:07.318107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c927b9a3-d6eb-4f3d-9569-12e74a23ef32 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.055021 Jul 28 01:15:07.322867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 90/180] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:07 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:15:08.080584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:08.081086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:08.087527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:08.087976 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:08.088749 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:08.089180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:08.244238 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:08.252403 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-edcb6894-4f36-4441-8cc0-0c6851cdd4da tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.175621 Jul 28 01:15:08.253035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 91/181] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:08 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:08.334027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-61f817b7-e140-4239-898b-f043a1319cf7 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7d1a60>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:08.381969 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-61f817b7-e140-4239-898b-f043a1319cf7 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.051956 Jul 28 01:15:08.382550 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 91/182] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:08 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:09.273874 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:09.274583 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:09.281771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:09.282254 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:09.283025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:09.283426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:09.397007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d5dae30e-4a76-4f46-8f10-2929a7657c63 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4940>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:09.432270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:09.440957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a1d728f2-161a-4fbc-a170-02ffb8139b09 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.170992 Jul 28 01:15:09.441534 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 92/183] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:09 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:09.465640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d5dae30e-4a76-4f46-8f10-2929a7657c63 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.072872 Jul 28 01:15:09.466231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 92/184] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:09 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:10.461911 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:10.462559 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:10.469488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:10.470031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:10.483261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:10.483261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:10.483482 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9648ccf3-019a-4500-a70a-158697cce919 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f41f0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:10.546084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9648ccf3-019a-4500-a70a-158697cce919 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 200 len: 344 microversion: 2.1 time: 0.069623 Jul 28 01:15:10.546903 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 93/185] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:10 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:10.654619 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:10.662642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-869fb291-0c39-40bc-830c-5d285e1c1633 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1521 microversion: 2.1 time: 0.204610 Jul 28 01:15:10.663254 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 93/186] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:10 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:11.561784 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45abc2f2-2856-47b9-bd17-997fff2caa95 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7f4310>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:11.595626 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-45abc2f2-2856-47b9-bd17-997fff2caa95 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] HTTP exception thrown: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45abc2f2-2856-47b9-bd17-997fff2caa95 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Request method failure captured: Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a HTTP/1.1 Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eMHDZcQ0M-H3oDUSK8FlArfJQDO0Ucaa3wR2HDXbqzYjMtq7hUrofMfZzD3vj8yeWYBCLfu0edioM1ko_lRErR3wK9t7BGh8iynjS0VqTtH__332pYrv0RZNLHJOAV3ZvdP1NGXRFx0JWNR7Z8k3w-Ug7xs_STtZLfN8x8ELcOr7Ww Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:15:11.597543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_16713d66669a42439081860207e6f6d6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/16713d66669a42439081860207e6f6d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: b9f094e1926c4cc6935762ec1eccdd98 Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '589273f1-c7b6-4f5f-bf06-b6042ae9813a'} Jul 28 01:15:11.598891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. (HTTP 404) (Request-ID: req-7a769653-e6b1-443a-9ac8-c25c43c976d8) Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.599604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:15:11.601125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 01:15:11.602135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.603138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45abc2f2-2856-47b9-bd17-997fff2caa95 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Returning 404 to user: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:15:11.603817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2020611705", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:11.604276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-45abc2f2-2856-47b9-bd17-997fff2caa95 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 404 len: 109 microversion: 2.1 time: 0.041082 Jul 28 01:15:11.604276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 94/187] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:11 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:15:11.614248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c40f7c54-47f6-4518-b198-e7fcbf528eda tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7d1d30>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:11.648832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-c40f7c54-47f6-4518-b198-e7fcbf528eda tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] HTTP exception thrown: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c40f7c54-47f6-4518-b198-e7fcbf528eda tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Request method failure captured: Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a HTTP/1.1 Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eMHDZcQ0M-H3oDUSK8FlArfJQDO0Ucaa3wR2HDXbqzYjMtq7hUrofMfZzD3vj8yeWYBCLfu0edioM1ko_lRErR3wK9t7BGh8iynjS0VqTtH__332pYrv0RZNLHJOAV3ZvdP1NGXRFx0JWNR7Z8k3w-Ug7xs_STtZLfN8x8ELcOr7Ww Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:15:11.651600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_16713d66669a42439081860207e6f6d6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/16713d66669a42439081860207e6f6d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: b9f094e1926c4cc6935762ec1eccdd98 Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '589273f1-c7b6-4f5f-bf06-b6042ae9813a'} Jul 28 01:15:11.652973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. (HTTP 404) (Request-ID: req-d6fa17b9-df5b-4075-bd4d-c43ce405359b) Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.653741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 01:15:11.654982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 01:15:11.656217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.657376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.658738 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c40f7c54-47f6-4518-b198-e7fcbf528eda tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Returning 404 to user: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:15:11.659962 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] validate_networks() for None {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:15:11.660556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c40f7c54-47f6-4518-b198-e7fcbf528eda tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 404 len: 109 microversion: 2.1 time: 0.050175 Jul 28 01:15:11.661242 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 95/188] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:15:11 2022] DELETE /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:15:11.670826 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bb4bda5c-56bc-4cdf-a43b-81b224f3b763 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Calling method '.version_select at 0x7ff71c7d1e50>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:11.705248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-bb4bda5c-56bc-4cdf-a43b-81b224f3b763 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] HTTP exception thrown: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bb4bda5c-56bc-4cdf-a43b-81b224f3b763 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Request method failure captured: Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a HTTP/1.1 Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eMHDZcQ0M-H3oDUSK8FlArfJQDO0Ucaa3wR2HDXbqzYjMtq7hUrofMfZzD3vj8yeWYBCLfu0edioM1ko_lRErR3wK9t7BGh8iynjS0VqTtH__332pYrv0RZNLHJOAV3ZvdP1NGXRFx0JWNR7Z8k3w-Ug7xs_STtZLfN8x8ELcOr7Ww Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:15:11.707591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16713d66669a42439081860207e6f6d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_16713d66669a42439081860207e6f6d6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/16713d66669a42439081860207e6f6d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 16713d66669a42439081860207e6f6d6 Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345470132 Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: b9f094e1926c4cc6935762ec1eccdd98 Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345470132-project Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '589273f1-c7b6-4f5f-bf06-b6042ae9813a'} Jul 28 01:15:11.708988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. (HTTP 404) (Request-ID: req-493da330-f688-4cee-ba00-1b8f0094744d) Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.709819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:15:11.711084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 01:15:11.712541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. Jul 28 01:15:11.713726 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:11.715861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bb4bda5c-56bc-4cdf-a43b-81b224f3b763 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] Returning 404 to user: Volume 589273f1-c7b6-4f5f-bf06-b6042ae9813a could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:15:11.716885 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bb4bda5c-56bc-4cdf-a43b-81b224f3b763 tempest-VolumesSnapshotsTestJSON-345470132 tempest-VolumesSnapshotsTestJSON-345470132-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a" status: 404 len: 109 microversion: 2.1 time: 0.051411 Jul 28 01:15:11.717600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 96/189] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:15:11 2022] GET /compute/v2.1/os-volumes/589273f1-c7b6-4f5f-bf06-b6042ae9813a => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 01:15:11.732379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:11.733900 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:11.741784 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:11.742457 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:11.743457 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:11.744037 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:12.070031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:12.098288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6e225111-1fdf-4206-b970-34855df274ee tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1501 microversion: 2.1 time: 0.373093 Jul 28 01:15:12.113054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 97/190] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:11 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1501 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:12.125288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:12.126373 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:12.135188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:12.135852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:12.136708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:12.137379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:12.264476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:15:12.264968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:15:12.265445 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:15:12.265923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:15:12.266518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:15:12.276086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:12.276624 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:12.277695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:12.278291 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:12.295574 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Getting quotas for project dcfd0d3d2054418b8e8276af1dab455f. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:15:12.299580 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Getting quotas for user bf878f8a5ae341098a6b77c46b1a077a and project dcfd0d3d2054418b8e8276af1dab455f. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:15:12.310669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:15:12.312954 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:15:12.333811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:12.342112 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7196871e-9fe8-4063-933b-db6f3e6dc883 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1514 microversion: 2.1 time: 0.222263 Jul 28 01:15:12.342692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 98/191] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:12 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:12.383963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-321c07bf-16ef-4136-8e2b-e2b07d5f668a tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789741 Jul 28 01:15:12.390932 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 94/192] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:15:12.396363 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-049fca90-d925-4f42-9d5d-c80ca8bcca5d tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:12.397070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-049fca90-d925-4f42-9d5d-c80ca8bcca5d tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:12.464489 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-049fca90-d925-4f42-9d5d-c80ca8bcca5d tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:12.483982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-049fca90-d925-4f42-9d5d-c80ca8bcca5d tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1215 microversion: 2.1 time: 0.091576 Jul 28 01:15:12.484927 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 99/193] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:12 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:13.505191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:13.505794 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:13.512452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:13.513164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:13.514103 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:13.514569 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:13.577630 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:13.585609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f13bc190-6e6f-420e-8fd8-d21ba2f9b06e tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1219 microversion: 2.1 time: 0.085187 Jul 28 01:15:13.586169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 95/194] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:13 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:14.607272 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:14.607883 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:14.614882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:14.615594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:14.616369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:14.616801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:14.689530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:14.697599 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f8c1ede7-bbda-4f5b-bed9-8c46777504a0 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1267 microversion: 2.1 time: 0.094385 Jul 28 01:15:14.698263 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 100/195] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:14 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:15.719488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:15.720846 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:15.729624 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:15.730533 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:15.731988 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:15.732702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:15.821132 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:15.830129 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ff750994-b243-4f46-bf68-ed2a4a42e864 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1273 microversion: 2.1 time: 0.114502 Jul 28 01:15:15.831433 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 96/196] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:15 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:15.964207 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:15.966680 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:15.973118 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:15.973742 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:15.975877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:15.976425 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:16.008825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lazy-loading 'flavor' on Instance uuid e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:15:16.162916 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fe3a893e-d544-4070-bb50-28c5b468064b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8/action" status: 200 len: 32 microversion: 2.1 time: 0.202558 Jul 28 01:15:16.164412 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 101/197] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:15:15 2022] POST /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:15:16.175064 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:16.176018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:16.185879 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:16.186355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:16.188450 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:16.188895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:16.858436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:16.859529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:16.872771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:16.876609 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:16.877077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:16.878991 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:16.880399 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:16.884074 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d75b2958-6b05-45d1-baad-b29ad52766c5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.713795 Jul 28 01:15:16.885426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 97/198] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:16 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:17.242463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:17.256867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2901a0a1-6151-41ab-aa23-c7b440e50f82 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1315 microversion: 2.1 time: 0.403332 Jul 28 01:15:17.259009 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 102/199] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:16 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:17.908016 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-70df510e-4952-479d-a564-f4c36fe71ffc req-a82f5d2f-8050-40db-85f6-30832bc4d1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34cd658-030b-4c77-b6f5-cbb0a88feb89", "tag": "869b9bb7-1fd2-46bb-b3e1-1f97f1f6790c"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:17.913854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:17.916118 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:17.935286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-70df510e-4952-479d-a564-f4c36fe71ffc req-a82f5d2f-8050-40db-85f6-30832bc4d1a1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:17.936465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-70df510e-4952-479d-a564-f4c36fe71ffc req-a82f5d2f-8050-40db-85f6-30832bc4d1a1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:17.940262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:17.942296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:17.956039 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-70df510e-4952-479d-a564-f4c36fe71ffc req-a82f5d2f-8050-40db-85f6-30832bc4d1a1 service nova] Creating event network-changed:869b9bb7-1fd2-46bb-b3e1-1f97f1f6790c for instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 on hv-cinder-81558 Jul 28 01:15:17.958640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:17.963804 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:17.965181 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-70df510e-4952-479d-a564-f4c36fe71ffc req-a82f5d2f-8050-40db-85f6-30832bc4d1a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060737 Jul 28 01:15:17.968825 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 98/200] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:18.281798 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:18.282979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:18.291216 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:18.291562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:18.292133 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:18.292428 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:18.292854 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:18.300671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a8837129-0c2b-42ca-ac92-b339285e1c7a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.395302 Jul 28 01:15:18.303219 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 103/201] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:17 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:18.585493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:18.599307 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5d7eb62c-12a8-46e4-9c70-07a05cc0be3f tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1315 microversion: 2.1 time: 0.322479 Jul 28 01:15:18.600064 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 99/202] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:18 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:19.332178 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:19.333091 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:19.339495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:19.340188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:19.341290 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:19.341814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:19.582794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:19.597397 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f96d02c1-25ce-4e95-af8b-6a82a61debd8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.270252 Jul 28 01:15:19.610884 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 104/203] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:19 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:19.621632 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:19.622247 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:19.639422 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:19.642956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:19.644076 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:19.644744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:19.924971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:19.935672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dbe3dabe-4493-4e92-9808-ef4742e8e4b6 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1315 microversion: 2.1 time: 0.317520 Jul 28 01:15:19.937280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 100/204] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:19 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:20.620713 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:20.622081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:20.634707 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:20.635762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:20.636824 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:20.637709 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:20.960376 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:20.963025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:20.976254 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:20.977476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:20.979286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:20.980124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:21.060304 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:21.076434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b49a320f-3a30-4d2e-9b2e-94a961a2fa85 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.461948 Jul 28 01:15:21.077391 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 105/205] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:20 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:21.298379 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:21.308452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-db9a1d48-0a36-43f0-ba40-286d7db9f656 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1315 microversion: 2.1 time: 0.353193 Jul 28 01:15:21.309952 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 101/206] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:20 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:22.102047 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:22.102718 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:22.122472 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:22.123152 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:22.124078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:22.124493 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:22.333971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:22.335732 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:22.339183 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:22.342432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:22.354312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:22.365449 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:22.367842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:22.370891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:22.442962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:22.457702 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-83db434a-5f50-4cd2-840a-e3aa65997df0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.359839 Jul 28 01:15:22.458268 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 106/207] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:22 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:22.711013 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:22.721292 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1c738214-9110-40c1-976a-d32ec4b07393 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1315 microversion: 2.1 time: 0.394930 Jul 28 01:15:22.738662 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 102/208] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:22 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:23.297640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-c4113edc-8772-4d1b-a6bb-a5a5b6ebc81d req-ff3fe739-fbb1-47dc-8aae-3fa685814794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34cd658-030b-4c77-b6f5-cbb0a88feb89", "name": "network-vif-plugged", "status": "completed", "tag": "869b9bb7-1fd2-46bb-b3e1-1f97f1f6790c"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:23.302801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:23.311612 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-c4113edc-8772-4d1b-a6bb-a5a5b6ebc81d req-ff3fe739-fbb1-47dc-8aae-3fa685814794 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:23.312396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-c4113edc-8772-4d1b-a6bb-a5a5b6ebc81d req-ff3fe739-fbb1-47dc-8aae-3fa685814794 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:23.334865 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-c4113edc-8772-4d1b-a6bb-a5a5b6ebc81d req-ff3fe739-fbb1-47dc-8aae-3fa685814794 service nova] Creating event network-vif-plugged:869b9bb7-1fd2-46bb-b3e1-1f97f1f6790c for instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 on hv-cinder-81558 Jul 28 01:15:23.345436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-c4113edc-8772-4d1b-a6bb-a5a5b6ebc81d req-ff3fe739-fbb1-47dc-8aae-3fa685814794 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050221 Jul 28 01:15:23.347180 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 107/209] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:23.482401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:23.483122 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:23.493835 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:23.494274 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:23.495211 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:23.495501 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:23.733130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:23.743873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3aac4cca-42be-4a42-bf77-980220849c82 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.265990 Jul 28 01:15:23.744550 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:23.745151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 103/210] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:23 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:23.745455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:23.756799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:23.757341 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:23.758116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:23.758744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:23.967505 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:23.976518 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-87226289-f658-4d7d-bae1-da90ef56fc49 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1315 microversion: 2.1 time: 0.236662 Jul 28 01:15:23.991848 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 108/211] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:23 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:24.767253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:24.768331 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:24.777801 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:24.778611 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:24.779557 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:24.780398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:24.997993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:24.999014 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:25.007398 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:25.008220 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:25.009334 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:25.009839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:25.069708 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:25.083253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-67d47f19-e627-491d-85e3-886689a3dfc2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.317287 Jul 28 01:15:25.097288 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 104/212] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:24 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:25.316819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:25.329592 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-04930f02-4733-4231-bdf2-9bdf357b99d9 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1315 microversion: 2.1 time: 0.335340 Jul 28 01:15:25.331003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 109/213] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:24 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:26.107331 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:26.107331 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:26.117634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:26.119210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:26.126240 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:26.127276 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:26.360336 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:26.361294 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:26.381649 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:26.382556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:26.384210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:26.384945 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:26.550675 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:26.559967 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e055eeb3-949c-4c41-991b-3f046446f71c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.458362 Jul 28 01:15:26.560567 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 105/214] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:26 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:26.690736 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:26.709362 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b015873-b2b5-4039-ae17-680033acf37c tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1465 microversion: 2.1 time: 0.353984 Jul 28 01:15:26.713663 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 110/215] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:26 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1465 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:26.809037 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:26.809539 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:26.826021 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:26.826523 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:26.829162 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:26.829652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:26.873997 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:15:26.963483 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:27.016971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6a2a35fc-7842-467f-8696-47f985110d00 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 204 len: 0 microversion: 2.1 time: 0.211739 Jul 28 01:15:27.017939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 106/216] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:15:26 2022] DELETE /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:15:27.027194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:27.027952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:27.034757 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:27.035237 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:27.036020 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:27.036455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:27.283371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:27.301611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fb0f00fc-0b51-4400-beb1-0c15720706c3 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1471 microversion: 2.1 time: 0.278409 Jul 28 01:15:27.303374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 111/217] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:27 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:27.582405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:27.583502 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:27.604360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:27.605250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:27.607351 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:27.608148 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:27.993968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:28.008066 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-89d8118d-116f-4263-9025-09f04373c110 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.429843 Jul 28 01:15:28.019308 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 107/218] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:27 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:28.328495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:28.329747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:28.339186 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:28.340013 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:28.341535 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:28.342555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:28.763382 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:28.778235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b44b8e1d-1356-4ece-9764-6ea89f340598 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1471 microversion: 2.1 time: 0.454561 Jul 28 01:15:28.781508 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 112/219] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:28 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1471 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:29.032816 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:29.033435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:29.048243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:29.048704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:29.049507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:29.049934 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:29.801901 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:29.803519 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:29.823562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:29.824232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:29.825204 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:29.825817 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:29.839152 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:30.649097 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:30.661889 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-39ac3074-ccd2-4555-af5a-db6f565b7569 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1471 microversion: 2.1 time: 0.864281 Jul 28 01:15:30.662496 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 113/220] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:29 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1471 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:30.700357 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:30.711631 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b7c569e7-941c-4281-97fc-d1f545b6c53d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 1.682316 Jul 28 01:15:30.714124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 108/221] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:29 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:31.217272 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-d2b6f60c-4482-409a-b48c-604679e7f535 req-a4186c4c-9c6c-4e82-b2a5-4358d07fda92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34cd658-030b-4c77-b6f5-cbb0a88feb89", "name": "network-vif-deleted", "tag": "869b9bb7-1fd2-46bb-b3e1-1f97f1f6790c"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:31.228995 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d2b6f60c-4482-409a-b48c-604679e7f535 req-a4186c4c-9c6c-4e82-b2a5-4358d07fda92 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:31.229668 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d2b6f60c-4482-409a-b48c-604679e7f535 req-a4186c4c-9c6c-4e82-b2a5-4358d07fda92 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:31.267523 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-d2b6f60c-4482-409a-b48c-604679e7f535 req-a4186c4c-9c6c-4e82-b2a5-4358d07fda92 service nova] Creating event network-vif-deleted:869b9bb7-1fd2-46bb-b3e1-1f97f1f6790c for instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 on hv-cinder-81558 Jul 28 01:15:31.274260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-d2b6f60c-4482-409a-b48c-604679e7f535 req-a4186c4c-9c6c-4e82-b2a5-4358d07fda92 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060755 Jul 28 01:15:31.276212 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 114/222] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:31.465061 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1000490850", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "networks": [{"uuid": "38ba4013-ec1c-4018-b20b-27b9ee596ca4"}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:31.482057 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:31.554724 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] validate_networks() for [('38ba4013-ec1c-4018-b20b-27b9ee596ca4', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:15:31.684311 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:31.685293 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:31.693754 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:31.695644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:31.696672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:31.697257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:31.774952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:31.775385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:31.775834 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lazy-loading 'fault' on Instance uuid e34cd658-030b-4c77-b6f5-cbb0a88feb89 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:15:31.850733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf878f8a5ae341098a6b77c46b1a077a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfd0d3d2054418b8e8276af1dab455f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:31.859553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-580a6411-5e87-473c-91b7-a90be9058867 tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 200 len: 1305 microversion: 2.1 time: 0.179687 Jul 28 01:15:31.873947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 115/223] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:31 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:31.873947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:31.873947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:31.877805 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:31.878257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:31.879062 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:31.879499 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:32.159057 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:15:32.160097 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:15:32.160726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:15:32.161311 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:15:32.161729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:15:32.183148 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:32.186003 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:32.187095 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:32.190819 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:32.205323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:32.218590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Getting quotas for project 0beae1c88e9948d28a386b5e31c68f85. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:15:32.223577 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Getting quotas for user 6f128878c21545e9aef8d9f9cb7b6881 and project 0beae1c88e9948d28a386b5e31c68f85. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:15:32.223791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-86fb3a51-0f95-496e-8df5-6431847e06d8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.362523 Jul 28 01:15:32.226780 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 116/224] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:31 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:32.248871 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:15:32.251397 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:15:32.351805 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-25f06271-3dec-4e03-91ac-3120007ddd94 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892630 Jul 28 01:15:32.353512 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 109/225] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:15:32.368269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c88ac172-05fa-4ff3-9e71-f081883facc1 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:32.369120 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c88ac172-05fa-4ff3-9e71-f081883facc1 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:32.486953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c88ac172-05fa-4ff3-9e71-f081883facc1 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:32.500177 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c88ac172-05fa-4ff3-9e71-f081883facc1 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1214 microversion: 2.1 time: 0.137101 Jul 28 01:15:32.502315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 117/226] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:32 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:32.883904 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:32.885011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] [instance: e34cd658-030b-4c77-b6f5-cbb0a88feb89] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:32.902273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:32.905434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:32.909285 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:32.910064 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:32.948421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] HTTP exception thrown: Instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 could not be found. Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Request method failure captured: Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 HTTP/1.1 Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eMa_mIQnq6SIS6LeHlmVaWPY5L7KTHE5qRyud2WmPh5RVVB6HooH5qFHxHXrIFGliL6yWUsPxw3ai9co0oji-gepUL8uDo4oy7yuQphYnlneek6IEWpQnwwdgLfM2oQNrn7v3q6P3ZD9C87rYcIZUQvlZCxTXMHkcpW08tfVpWsuds Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: dcfd0d3d2054418b8e8276af1dab455f Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-VolumesNegativeTest-1234449779 Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:15:32.951233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dcfd0d3d2054418b8e8276af1dab455f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dcfd0d3d2054418b8e8276af1dab455f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dcfd0d3d2054418b8e8276af1dab455f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dcfd0d3d2054418b8e8276af1dab455f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-VolumesNegativeTest-1234449779 Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: dcfd0d3d2054418b8e8276af1dab455f Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-VolumesNegativeTest-1234449779 Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-VolumesNegativeTest-1234449779-project Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: bf878f8a5ae341098a6b77c46b1a077a Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-VolumesNegativeTest-1234449779-project Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 could not be found. Jul 28 01:15:32.952524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'e34cd658-030b-4c77-b6f5-cbb0a88feb89'} Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 could not be found. Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:15:32.953363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 could not be found. Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 could not be found. Jul 28 01:15:32.954665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:32.958017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] Returning 404 to user: Instance e34cd658-030b-4c77-b6f5-cbb0a88feb89 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:15:32.958017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6d753a80-7b80-4d47-b3d2-b14fc262a9bf tempest-VolumesNegativeTest-1234449779 tempest-VolumesNegativeTest-1234449779-project] 10.222.0.17 "GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89" status: 404 len: 111 microversion: 2.1 time: 0.076689 Jul 28 01:15:32.958017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 110/227] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:32 2022] GET /compute/v2.1/servers/e34cd658-030b-4c77-b6f5-cbb0a88feb89 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:15:33.249818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:33.250516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:33.268496 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:33.268992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:33.278801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:33.283874 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:33.524579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:33.525355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:33.541924 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:33.545501 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:33.546703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:33.549096 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:33.549564 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:33.556037 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9cb4e4e4-9624-43d7-8ede-12aeb5c86706 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.312182 Jul 28 01:15:33.561735 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 118/228] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:33 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:33.769623 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:33.780917 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e15f62b7-ec07-4672-92eb-a0ef94cdd958 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1266 microversion: 2.1 time: 0.260179 Jul 28 01:15:33.782106 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 111/229] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:33 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:34.587615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:34.588147 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:34.600011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:34.600261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:34.601024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:34.601459 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:34.684733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-734f136d-920b-4f24-8b6c-736b8ca99966 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Action: 'create', calling method: .version_select at 0x7ff71c7d1ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-388651129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBdcP8R4JBR+rrv1hGqSt7keD+GoOEkiLRagn/UIrjgmUlTZbp1yN8VXJLvK9l3yvce/NV6Dsb1JgpJy/Pzmr84s4BRuotzkETaB++EcM3MyKLbIt8rVdQD5xQdEmTebg=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:34.704998 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-734f136d-920b-4f24-8b6c-736b8ca99966 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for project d14de33f76ea44db8899900481299b87. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:15:34.718034 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-734f136d-920b-4f24-8b6c-736b8ca99966 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for user d9cb42db2f9a4b80b17bef0a86945a6c and project d14de33f76ea44db8899900481299b87. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:15:34.784991 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-734f136d-920b-4f24-8b6c-736b8ca99966 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.339838 Jul 28 01:15:34.787389 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 119/230] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:15:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:34.803288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:34.804316 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:34.820593 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:34.821501 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:34.824044 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:34.825437 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:34.924584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:34.938608 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4a8dc731-02bc-4ce2-b907-9dfa6eab79db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.355062 Jul 28 01:15:34.939792 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 112/231] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:34 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:34.986200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:34.996065 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eb458117-c501-4881-8444-c5f6abf2f1f9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1272 microversion: 2.1 time: 0.197059 Jul 28 01:15:34.997422 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 120/232] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:34 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:35.429541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-bb5091f4-6780-4c76-9ae3-edbb59167686 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:35.430043 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-bb5091f4-6780-4c76-9ae3-edbb59167686 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:35.443608 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb5091f4-6780-4c76-9ae3-edbb59167686 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:35.446103 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb5091f4-6780-4c76-9ae3-edbb59167686 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:35.448804 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb5091f4-6780-4c76-9ae3-edbb59167686 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:35.449418 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb5091f4-6780-4c76-9ae3-edbb59167686 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:35.494443 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-bb5091f4-6780-4c76-9ae3-edbb59167686 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/ips" status: 200 len: 147 microversion: 2.1 time: 0.069438 Jul 28 01:15:35.496293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 113/233] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:15:35 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/ips => generated 147 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:35.968083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:35.971163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:35.980772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:35.982041 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:35.986505 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:35.987790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:36.018046 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:36.018653 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:36.028470 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:36.030483 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:36.033431 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:36.034873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:36.507570 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:36.521965 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b6c85915-2d5e-4680-8e82-2eb1b09a65e0 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.561057 Jul 28 01:15:36.522623 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 121/234] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:35 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:36.727829 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:36.745217 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1118c27b-c208-4729-8180-2dc3f53a8773 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1314 microversion: 2.1 time: 0.730925 Jul 28 01:15:36.745835 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 114/235] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:36 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:37.423942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-587c311d-7c67-400c-a459-471f7dc36f62 req-40929511-f283-40ac-b2fe-dadc83f3b196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222b4c4a-bb44-4b89-8ed5-946ba5069e67", "tag": "1e651628-e44f-4cfc-903e-a097217678bd"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:37.441881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-587c311d-7c67-400c-a459-471f7dc36f62 req-40929511-f283-40ac-b2fe-dadc83f3b196 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:37.443133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-587c311d-7c67-400c-a459-471f7dc36f62 req-40929511-f283-40ac-b2fe-dadc83f3b196 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:37.456319 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-587c311d-7c67-400c-a459-471f7dc36f62 req-40929511-f283-40ac-b2fe-dadc83f3b196 service nova] Creating event network-changed:1e651628-e44f-4cfc-903e-a097217678bd for instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 on hv-cinder-81558 Jul 28 01:15:37.463749 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-587c311d-7c67-400c-a459-471f7dc36f62 req-40929511-f283-40ac-b2fe-dadc83f3b196 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044690 Jul 28 01:15:37.464549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 122/236] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:37.546996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:37.548634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:37.564713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:37.565914 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:37.568252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:37.569836 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:37.771987 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:37.773419 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:37.786314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:37.788158 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:37.801062 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:37.801530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:38.153478 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:38.170289 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e73c7fd1-fbd7-42a1-889c-95619ec83ab2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.628474 Jul 28 01:15:38.179206 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 115/237] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:37 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:38.315680 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:38.329544 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4add1ee1-4afa-475b-8cb7-81caedd84f88 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1314 microversion: 2.1 time: 0.566896 Jul 28 01:15:38.339074 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 123/238] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:37 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:39.025153 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2c3d7fb0-4c41-4cc4-a52a-23cb17bf8c8c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b921fc59-6afd-45c6-a69e-0a559939c54b"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:39.029311 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2c3d7fb0-4c41-4cc4-a52a-23cb17bf8c8c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:39.036300 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2c3d7fb0-4c41-4cc4-a52a-23cb17bf8c8c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:39.036749 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2c3d7fb0-4c41-4cc4-a52a-23cb17bf8c8c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:39.037525 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2c3d7fb0-4c41-4cc4-a52a-23cb17bf8c8c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:39.037955 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2c3d7fb0-4c41-4cc4-a52a-23cb17bf8c8c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:39.195791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:39.196382 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:39.198428 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:39.204201 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:39.204660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:39.205461 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:39.205897 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:39.366043 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:39.375245 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b30d7533-5353-4ffa-910b-eb8f14a0f04b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.183324 Jul 28 01:15:39.376585 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 124/239] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:39 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:39.382574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:39.383423 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:39.396087 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:39.396694 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:39.398004 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:39.398584 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:39.597907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:39.609603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0aac63da-8985-429e-abb4-09b408752bb9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1314 microversion: 2.1 time: 0.231513 Jul 28 01:15:39.610731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 125/240] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:39 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:39.896033 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2c3d7fb0-4c41-4cc4-a52a-23cb17bf8c8c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875071 Jul 28 01:15:39.898926 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 116/241] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:15:39 2022] POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:40.398240 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:40.398953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:40.412082 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:40.412534 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:40.413412 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:40.416711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:40.618704 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:40.630122 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7beb1d21-298f-488d-ba72-5964ce6d0ed4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.236872 Jul 28 01:15:40.630720 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 126/242] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:40 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:40.651187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:40.651897 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:40.658695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:40.659463 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:40.660435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:40.661018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:40.812058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:40.826214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b46caae6-64fc-4748-ba66-9df25eea657f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1314 microversion: 2.1 time: 0.179049 Jul 28 01:15:40.835633 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 117/243] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:40 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:41.655108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:41.655759 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:41.662879 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:41.663329 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:41.664141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:41.664572 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:41.799350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:41.806897 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1ae747a5-e35d-4d09-b10b-f42cbfe22aae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.156053 Jul 28 01:15:41.807578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 127/244] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:41 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:41.847713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:41.848288 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:41.855167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:41.855612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:41.856374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:41.856802 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:41.999706 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:42.011515 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-35526fab-cbd1-46be-8113-cf4738b7ef11 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1314 microversion: 2.1 time: 0.167410 Jul 28 01:15:42.012191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 118/245] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:41 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:42.828898 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:42.829486 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:42.836051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:42.836510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:42.837310 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:42.837861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:42.965391 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-0abb7d14-5a55-4af2-91e6-24de03621928 req-5e08631c-627e-4858-a662-8297673045b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222b4c4a-bb44-4b89-8ed5-946ba5069e67", "name": "network-vif-plugged", "status": "completed", "tag": "1e651628-e44f-4cfc-903e-a097217678bd"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:42.971769 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:42.972695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:42.975787 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:42.981604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-0abb7d14-5a55-4af2-91e6-24de03621928 req-5e08631c-627e-4858-a662-8297673045b2 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:42.982304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-0abb7d14-5a55-4af2-91e6-24de03621928 req-5e08631c-627e-4858-a662-8297673045b2 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:42.984110 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d6fc25a-65e0-470f-bd89-ea4e5f9757c7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.159305 Jul 28 01:15:42.985227 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 128/246] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:42 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:43.011346 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-0abb7d14-5a55-4af2-91e6-24de03621928 req-5e08631c-627e-4858-a662-8297673045b2 service nova] Creating event network-vif-plugged:1e651628-e44f-4cfc-903e-a097217678bd for instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 on hv-cinder-81558 Jul 28 01:15:43.016523 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-0abb7d14-5a55-4af2-91e6-24de03621928 req-5e08631c-627e-4858-a662-8297673045b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054859 Jul 28 01:15:43.017149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 119/247] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:15:43.040773 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:43.041850 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:43.048790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:43.049471 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:43.050432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:43.051182 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:43.223621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ba84bdab-d519-4d00-a8c2-88e08dd7e74d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:43.224857 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ba84bdab-d519-4d00-a8c2-88e08dd7e74d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:43.232596 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ba84bdab-d519-4d00-a8c2-88e08dd7e74d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:43.233347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ba84bdab-d519-4d00-a8c2-88e08dd7e74d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:43.235474 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ba84bdab-d519-4d00-a8c2-88e08dd7e74d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:43.236777 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ba84bdab-d519-4d00-a8c2-88e08dd7e74d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:43.243165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:43.251705 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fd29b2e1-6e62-4db8-aa18-5b463035dcb8 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1314 microversion: 2.1 time: 0.217472 Jul 28 01:15:43.252517 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 129/248] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:43 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:43.279422 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ba84bdab-d519-4d00-a8c2-88e08dd7e74d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/ips" status: 200 len: 152 microversion: 2.20 time: 0.060057 Jul 28 01:15:43.286391 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 120/249] 10.222.0.17 () {60 vars in 1289 bytes} [Thu Jul 28 01:15:43 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/ips => generated 152 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 01:15:44.011159 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:44.012138 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:44.019672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:44.020028 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:44.021201 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:44.021880 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:44.188234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:44.196876 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-aa1b6017-bd96-4d49-88e3-56f04086f671 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.189856 Jul 28 01:15:44.198321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 130/250] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:44 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:44.277109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:44.278668 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:44.286728 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:44.287488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:44.288640 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:44.289041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:44.470304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:44.479000 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4a345428-b765-40e4-a412-44161f5cc41c tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1314 microversion: 2.1 time: 0.206603 Jul 28 01:15:44.479704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 121/251] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:44 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:45.225781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:45.226628 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:45.230864 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:45.235494 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:45.236295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:45.237104 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:45.237545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:45.424238 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:45.424767 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:45.425984 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:45.434807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:45.435213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3977c507-2173-4154-a718-9e01cf4beb2d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.213526 Jul 28 01:15:45.438759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:45.439732 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:45.440272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:45.443251 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 131/252] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:45 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:45.475446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lazy-loading 'flavor' on Instance uuid 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:15:45.506209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:45.507223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:45.516484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:45.517155 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:45.524081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:45.524541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:45.562941 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:45.741448 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:45.745160 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:45.749728 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d61d1355-ca74-4035-a373-ed459842fff5 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1498 microversion: 2.1 time: 0.253150 Jul 28 01:15:45.750335 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 132/253] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:45 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:46.315089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:46.315754 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:46.324543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:46.325210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:46.326532 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:46.327386 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:46.368460 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:15:46.526110 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3bd4e392-2029-4357-b8fd-f0581c5b5443 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "DELETE /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 204 len: 0 microversion: 2.1 time: 0.212008 Jul 28 01:15:46.534638 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 133/254] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:15:46 2022] DELETE /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:15:46.550437 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:46.551594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:46.559527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:46.561250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:46.562279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:46.564298 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:46.789490 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:46.805449 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-245dc661-75ed-40c3-add9-ab26b7a9e158 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.268761 Jul 28 01:15:46.806047 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 134/255] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:46 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:46.817562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:46.818982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:46.827651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:46.828478 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:46.829610 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:46.830310 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:47.154365 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:47.162953 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d28ec07-0867-4069-8dca-bd244e399718 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1504 microversion: 2.1 time: 0.351732 Jul 28 01:15:47.163728 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 135/256] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:46 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:47.828599 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:47.829823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:47.841865 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:47.843520 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:47.847822 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:47.849126 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:48.543747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:48.554461 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e642373a-f394-441e-ad70-567cb5220a79 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.730141 Jul 28 01:15:48.555094 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 136/257] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:47 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:48.579445 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:48.580074 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:48.597035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:48.597904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:48.599649 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:48.600480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:49.084123 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:49.093201 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-476e39f3-362f-456f-ab5c-3216006f029a tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1504 microversion: 2.1 time: 0.521645 Jul 28 01:15:49.093874 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 137/258] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:48 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1504 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:49.099983 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1c0b68e3-7698-4a04-97a6-16265a53d626 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:49.108532 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c0b68e3-7698-4a04-97a6-16265a53d626 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:49.109323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c0b68e3-7698-4a04-97a6-16265a53d626 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:49.189873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1c0b68e3-7698-4a04-97a6-16265a53d626 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Going to try to stop instance {{(pid=117958) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 01:15:49.243069 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1c0b68e3-7698-4a04-97a6-16265a53d626 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action" status: 202 len: 0 microversion: 2.1 time: 0.146621 Jul 28 01:15:49.244429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 138/259] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:15:49 2022] POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:15:49.255992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:49.257778 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:49.267940 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:49.269671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:49.270769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:49.271588 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:49.774103 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:49.784355 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-412ece17-ee86-4fce-bdfc-14ba9848d031 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.534153 Jul 28 01:15:49.785248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 139/260] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:49 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:49.790455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:49.791431 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:49.812279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:49.812797 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:49.821487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:49.821936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:50.067055 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:50.085867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-209db3d4-f571-4183-87db-b6bfef3c89ca tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.297706 Jul 28 01:15:50.088369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 140/261] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:49 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:50.104033 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-4e8c9b2c-205f-4b32-928c-69286d73d37d req-7e4fd95d-dc13-43de-9789-8006facb87a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222b4c4a-bb44-4b89-8ed5-946ba5069e67", "name": "network-vif-deleted", "tag": "1e651628-e44f-4cfc-903e-a097217678bd"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:50.115593 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4e8c9b2c-205f-4b32-928c-69286d73d37d req-7e4fd95d-dc13-43de-9789-8006facb87a0 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:50.116420 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4e8c9b2c-205f-4b32-928c-69286d73d37d req-7e4fd95d-dc13-43de-9789-8006facb87a0 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:50.132385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-4e8c9b2c-205f-4b32-928c-69286d73d37d req-7e4fd95d-dc13-43de-9789-8006facb87a0 service nova] Creating event network-vif-deleted:1e651628-e44f-4cfc-903e-a097217678bd for instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 on hv-cinder-81558 Jul 28 01:15:50.137919 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-4e8c9b2c-205f-4b32-928c-69286d73d37d req-7e4fd95d-dc13-43de-9789-8006facb87a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046427 Jul 28 01:15:50.138899 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 141/262] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:15:50.144632 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:50.145743 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:50.153471 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:50.154341 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:50.158777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:50.159725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:50.210778 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:50.211562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:50.212134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lazy-loading 'fault' on Instance uuid 222b4c4a-bb44-4b89-8ed5-946ba5069e67 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:15:50.299676 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:50.312463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-208522cb-8683-4d6a-888e-f468742b23f6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 200 len: 1304 microversion: 2.1 time: 0.167921 Jul 28 01:15:50.313382 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 142/263] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:50 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:50.809624 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:50.810563 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:50.817130 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:50.817604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:50.818587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:50.819996 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:51.052006 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:51.066328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-593269ea-ceed-4ab5-8284-23f0c47be336 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.260945 Jul 28 01:15:51.072026 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 143/264] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:50 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:51.119794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:51.120479 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:51.133017 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:51.133514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:51.134347 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:51.134799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:51.345274 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:51.359292 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fa92e673-179b-4703-a2fe-3373ebc753d5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.243433 Jul 28 01:15:51.362630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 144/265] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:51 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:51.371216 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:51.372198 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 222b4c4a-bb44-4b89-8ed5-946ba5069e67] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:51.379572 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:51.380436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:51.381218 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:51.381720 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:51.399784 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] HTTP exception thrown: Instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 could not be found. Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Request method failure captured: Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 HTTP/1.1 Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eMwbMKnah8pgAqfH_CyZWiFAGPsy4dmMREHVitxZHWrTnkSGarzr-1A6GwHPfR1XBIs-CmUJ1HlDYTGjy4rrvxfgqTkhQIorVOlQl-qqRrZiJXEqwclifQCMNs5LpkU5L2Fy8hWdhR7xlzU0Xg9ZKDH-1QL5wGtDjCsxmUMlnGfLGk Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 0beae1c88e9948d28a386b5e31c68f85 Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesActionsTest-1672736751 Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:15:51.401469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0beae1c88e9948d28a386b5e31c68f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0beae1c88e9948d28a386b5e31c68f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0beae1c88e9948d28a386b5e31c68f85", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0beae1c88e9948d28a386b5e31c68f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesActionsTest-1672736751 Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 0beae1c88e9948d28a386b5e31c68f85 Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesActionsTest-1672736751 Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesActionsTest-1672736751-project Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6f128878c21545e9aef8d9f9cb7b6881 Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesActionsTest-1672736751-project Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 could not be found. Jul 28 01:15:51.403007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '222b4c4a-bb44-4b89-8ed5-946ba5069e67'} Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 could not be found. Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:15:51.403967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 could not be found. Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 could not be found. Jul 28 01:15:51.405337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:15:51.417877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Returning 404 to user: Instance 222b4c4a-bb44-4b89-8ed5-946ba5069e67 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:15:51.419057 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-91ec699d-1c70-4df0-b228-79a7b0a4a023 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67" status: 404 len: 111 microversion: 2.1 time: 0.055116 Jul 28 01:15:51.420313 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 145/266] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:51 2022] GET /compute/v2.1/servers/222b4c4a-bb44-4b89-8ed5-946ba5069e67 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:15:51.563031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1579618582", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "networks": [{"uuid": "38ba4013-ec1c-4018-b20b-27b9ee596ca4"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:54.537280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ab6d1b9e-725b-4e1c-9017-12e7dc46cc03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/action" status: 202 len: 0 microversion: 2.20 time: 9.117190 Jul 28 01:15:54.539132 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 122/267] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Jul 28 01:15:45 2022] POST /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/action => generated 0 bytes in 9120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 01:15:54.545424 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:54.546418 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:54.549174 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] validate_networks() for [('38ba4013-ec1c-4018-b20b-27b9ee596ca4', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:15:54.555395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:54.556118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:54.557084 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:54.557677 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:55.089088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:55.102573 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3e9fbc1d-1c25-4e9f-8e39-ab26199295af tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.561972 Jul 28 01:15:55.103792 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 123/268] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:54 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:55.115495 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:55.117128 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:55.127347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:55.127942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:55.128824 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:55.130452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:55.534811 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:55.542876 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7783789a-28e6-4824-bf7b-ef79cbf1f336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.437658 Jul 28 01:15:55.554923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 124/269] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:55 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:55.554923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:55.554923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:55.557321 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:55.557969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:55.558967 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:55.559408 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:55.755883 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:15:55.757050 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:15:55.757610 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:15:55.758083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:15:55.758557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:15:55.794962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:55.796778 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:55.801153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:55.801853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:55.838487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Getting quotas for project 0beae1c88e9948d28a386b5e31c68f85. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:15:55.840127 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:55.849217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Getting quotas for user 6f128878c21545e9aef8d9f9cb7b6881 and project 0beae1c88e9948d28a386b5e31c68f85. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:15:55.857141 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:55.863710 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:55.876960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:15:55.883086 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:15:55.890265 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-cbae7895-2a46-42fa-8904-7287f6cb40ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.329895 Jul 28 01:15:55.891036 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 125/270] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:15:55 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:15:55.948304 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fa8bc1b6-17c0-4621-9a52-62f159abb4dd tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.389690 Jul 28 01:15:55.949277 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 146/271] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 01:15:55.964142 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-65284ebe-5a57-4b45-a831-810ab25077c7 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:55.965138 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-65284ebe-5a57-4b45-a831-810ab25077c7 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:56.046216 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-65284ebe-5a57-4b45-a831-810ab25077c7 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:56.057086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-65284ebe-5a57-4b45-a831-810ab25077c7 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1214 microversion: 2.1 time: 0.097250 Jul 28 01:15:56.068121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 126/272] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:55 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:56.125836 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:56.126452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:56.134500 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:56.134977 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:56.135744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:56.136369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:56.456296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:56.480709 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc0a74ee-8eae-408f-b8bf-9009647811be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.357703 Jul 28 01:15:56.481862 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 147/273] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:56 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:56.566143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:56.566754 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:56.574677 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:56.575418 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:56.576210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:56.576692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:56.826999 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:56.835295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c6879c90-1db3-42cf-9472-62a02ded3e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.273080 Jul 28 01:15:56.836049 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 127/274] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:56 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:56.926300 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:56.927110 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:56.933688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:56.934299 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:56.935336 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:56.935871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:56.954937 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:15:57.078529 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:57.079617 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:57.086365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:57.087221 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:57.088163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:57.089040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:57.173167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:57.181143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-924b54a2-7e49-43a0-b104-b45b4ec7f35e tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1266 microversion: 2.1 time: 0.106648 Jul 28 01:15:57.182286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 128/275] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:57 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:57.183770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:57.196755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:57.198241 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:57.199489 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-351b3555-2815-4110-a19b-241de03c1c53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.277574 Jul 28 01:15:57.211296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 148/276] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:15:56 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:15:57.507277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:57.508934 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:57.525224 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:57.526294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:57.527640 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:57.528374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:57.856513 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:57.857394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:57.864821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:57.865224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:57.868824 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:57.869564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:57.914062 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:57.925213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b0339cd5-08c3-4792-93a8-ce511752d93c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.424891 Jul 28 01:15:57.926975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 129/277] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:57 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:58.201910 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:58.202535 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:58.208972 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.209744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.210759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.211600 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.271902 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:58.283110 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1e92e5d-5520-45b1-9275-61285875cbbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1500 microversion: 2.1 time: 0.430323 Jul 28 01:15:58.295205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 149/278] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:57 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1500 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:58.295205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:58.295205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:58.315177 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.315905 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.317020 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.317611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.343177 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:58.351862 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e8438612-befe-49e6-9f03-83d9c02e34ad tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1272 microversion: 2.1 time: 0.153823 Jul 28 01:15:58.353014 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 130/279] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:58 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:15:58.362561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09dbdf3d-f34b-434d-8229-221496646be8"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:58.365092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:58.371954 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.372407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.373207 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.373643 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.400882 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] HTTP exception thrown: Cannot 'attach_volume' instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 while it is in vm_state rescued Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Request method failure captured: Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: POST /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8/os-volume_attachments HTTP/1.1 Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 74 Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLP45uroqJY4tOsw7MzTomogGWczHPDBPjWIO4CSfNcgqhyAZkGNfMAc1Lcng3yx2yG0MrSBbkOLlmT4zOZMqI_5XzYT1aMh3SmbedkYL5v7LOhTHKjqJ180qmpftqTXj8-ryE0chsIPWl-kLy3n4x47dkOY2VUMTOGAnfMLyF6vJU Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:15:58.402612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af4689d2f0ef4d71a1c465610011f2d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 018eb80709e94d5e8653fb6eeb342c54 Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {"volumeAttachment": {"volumeId": "09dbdf3d-f34b-434d-8229-221496646be8"}} Jul 28 01:15:58.404219 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Cannot 'attach_volume' instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 while it is in vm_state rescued Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'server_id': 'e26acfa5-94f2-4d1d-8bfd-9f82e73861f8', 'body': {'volumeAttachment': {'volumeId': '09dbdf3d-f34b-434d-8229-221496646be8'}}} Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:15:58.404990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 while it is in vm_state rescued Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:15:58.406048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:15:58.407242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:15:58.407242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:15:58.407242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 while it is in vm_state rescued Jul 28 01:15:58.407242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:15:58.407242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Returning 409 to user: Cannot 'attach_volume' instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 while it is in vm_state rescued {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:15:58.407242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2324b7c2-7f43-4cae-bd5b-277d22e4141e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049724 Jul 28 01:15:58.407242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 131/280] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:15:58 2022] POST /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 01:15:58.415963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-56431eff-5e85-49e9-899e-75490e5bae64 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:15:58.416668 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-56431eff-5e85-49e9-899e-75490e5bae64 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:58.423837 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-56431eff-5e85-49e9-899e-75490e5bae64 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.424435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-56431eff-5e85-49e9-899e-75490e5bae64 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.425327 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-56431eff-5e85-49e9-899e-75490e5bae64 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.425992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-56431eff-5e85-49e9-899e-75490e5bae64 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.545775 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-56431eff-5e85-49e9-899e-75490e5bae64 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8/action" status: 202 len: 0 microversion: 2.1 time: 0.133385 Jul 28 01:15:58.550327 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 132/281] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:15:58 2022] POST /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:15:58.557579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:58.560086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:58.568980 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.569975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.571300 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.571990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.725631 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:58.736141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:58.737819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:58.739064 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc434947-6a10-40fd-a0eb-d2a36db8d967 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.449930 Jul 28 01:15:58.739893 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 150/282] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:15:58 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:15:58.946730 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:58.947360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:58.953665 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.954108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:58.954861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:58.955327 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:59.023571 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:59.032674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-32982faf-dcd0-4149-b0d1-3ba45a343eaa tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1508 microversion: 2.1 time: 0.480719 Jul 28 01:15:59.033276 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 133/283] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:58 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1508 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:59.342679 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:59.350994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d95049f-934c-4c2f-9d46-af27e1e6acda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.408165 Jul 28 01:15:59.351920 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 151/284] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:58 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:59.380634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:59.382091 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:59.390299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:59.390758 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:59.391827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:59.392437 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:59.530599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:15:59.540003 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5ca3d044-6d55-4061-80f5-34d8182e4f85 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1272 microversion: 2.1 time: 0.166950 Jul 28 01:15:59.540864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 134/285] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:15:59 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:15:59.766327 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:15:59.767340 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:15:59.773608 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:59.774051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:15:59.774821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:15:59.775299 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:00.055799 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:00.056733 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:00.065018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:00.065691 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:00.067046 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:00.067913 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:00.176533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:00.189296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:00.192324 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:00.193637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ff88cf2e-90d6-4bc3-b031-e3c90d006d85 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.432785 Jul 28 01:16:00.194379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 152/286] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:15:59 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:00.328422 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:00.336965 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-70ce6228-d1cc-4161-b232-668a3217cadb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1508 microversion: 2.1 time: 0.285884 Jul 28 01:16:00.338005 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 135/287] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:00 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:00.375516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:00.376109 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:00.383222 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:00.383675 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:00.384457 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:00.384892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:00.561912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:00.562531 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:00.574725 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:00.575353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:00.576175 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:00.576608 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:01.137070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:01.146818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ffe8fb9-5920-4c2c-a6f7-f12af1c22df8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.777555 Jul 28 01:16:01.147708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 153/288] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:00 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:01.178908 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:01.189284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e68d3dcb-7737-4ba6-b212-8e733b024872 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1314 microversion: 2.1 time: 0.632084 Jul 28 01:16:01.190255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 136/289] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:00 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:01.224177 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:01.224972 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:01.237230 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:01.238463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:01.240656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:01.241730 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:01.361120 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:01.362309 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:01.370527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:01.374255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:01.376332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:01.379035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:01.672734 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:01.685962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:01.687744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:01.693940 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-10a781c2-2323-4d4c-a66a-de98322a5f53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.471936 Jul 28 01:16:01.695021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 154/290] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:01 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:01.711159 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-0e52db0c-1c35-4801-a542-a802cf13a3b4 req-4fdc5a45-134a-484b-a0f4-c91cd297d302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0adff266-7f29-4fd6-9852-05c6bafae8e3", "tag": "7aca7690-85ad-4c74-8cea-1f48979942ea"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:01.716694 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:01.734632 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7bced179-dc7d-4825-8f6a-1ae8652027ae tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1508 microversion: 2.1 time: 0.373371 Jul 28 01:16:01.735017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 137/291] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:01 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:01.741454 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0e52db0c-1c35-4801-a542-a802cf13a3b4 req-4fdc5a45-134a-484b-a0f4-c91cd297d302 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:01.742338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0e52db0c-1c35-4801-a542-a802cf13a3b4 req-4fdc5a45-134a-484b-a0f4-c91cd297d302 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:01.755199 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-0e52db0c-1c35-4801-a542-a802cf13a3b4 req-4fdc5a45-134a-484b-a0f4-c91cd297d302 service nova] Creating event network-changed:7aca7690-85ad-4c74-8cea-1f48979942ea for instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 on hv-cinder-81558 Jul 28 01:16:01.760576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-0e52db0c-1c35-4801-a542-a802cf13a3b4 req-4fdc5a45-134a-484b-a0f4-c91cd297d302 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063607 Jul 28 01:16:01.761178 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 155/292] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:02.032776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-112779471", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-388651129", "security_groups": [{"name": "tempest-secgroup-smoke-1741610070"}], "block_device_mapping_v2": [{"uuid": "0fe0bd15-81ee-4791-b0a4-bab97182091d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f365ac42-75a7-4c3d-8591-d4097c9f6065"}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:02.045864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:02.172054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:02.172928 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:02.210561 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:02.215051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:02.216755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:02.217768 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:02.324734 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] validate_networks() for [('f365ac42-75a7-4c3d-8591-d4097c9f6065', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:16:02.977300 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:02.989917 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dbe22445-78fa-47c9-ab21-9c44cdf45bda tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.823662 Jul 28 01:16:02.990629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 156/293] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:02 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:03.051619 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:03.054997 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:03.097512 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.098290 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:03.100231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.104048 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:03.532858 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:16:03.533697 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:16:03.533871 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:16:03.534139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:16:03.546324 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:16:03.602031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.602548 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:03.603370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.607557 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:03.619185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:03.629306 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-215aafd8-a031-4690-88ec-6e069df5c544 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1314 microversion: 2.1 time: 0.610058 Jul 28 01:16:03.639166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 157/294] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:02 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:03.639279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:03.639812 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:03.650640 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for project d14de33f76ea44db8899900481299b87. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:16:03.661432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for user d9cb42db2f9a4b80b17bef0a86945a6c and project d14de33f76ea44db8899900481299b87. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:16:03.670985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.673328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:03.674301 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.674880 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:03.892366 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:16:03.894522 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fe0bd15-81ee-4791-b0a4-bab97182091d',volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:16:03.923166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:03.933020 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:03.938710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:03.943194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-660d710b-2536-4a65-bc2e-95d9b08f290b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.307894 Jul 28 01:16:03.944017 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 158/295] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:03 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:03.959487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:03.960512 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:03.972942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.973508 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:03.974415 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:03.976546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:04.173277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a4b4922b-0e0a-4328-b582-870edc134016 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.145540 Jul 28 01:16:04.173990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 138/296] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:16:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:16:04.187230 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:04.188354 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:04.211222 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:04.211976 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:04.213017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:04.213677 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:04.249344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:04.267332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c93858ed-2767-4caf-a3a6-cfd99be4eb08 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1514 microversion: 2.1 time: 0.318422 Jul 28 01:16:04.270141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 159/297] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:03 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:04.283216 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fdbbc35d-c07f-493d-b892-8c20e3b12699 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:04.285806 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fdbbc35d-c07f-493d-b892-8c20e3b12699 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:04.513248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fdbbc35d-c07f-493d-b892-8c20e3b12699 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:04.527498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fdbbc35d-c07f-493d-b892-8c20e3b12699 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1093 microversion: 2.1 time: 0.253827 Jul 28 01:16:04.535580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 160/298] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:04 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1093 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:04.621310 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:04.633773 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5fcf32c2-683a-4bd7-95c8-2a7a2d1521da tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1724 microversion: 2.1 time: 0.458292 Jul 28 01:16:04.634378 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 139/299] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:04 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:04.652808 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:04.653586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:04.672787 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:04.677298 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:04.681005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:04.693707 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:04.973489 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:04.975155 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:04.994524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:05.009379 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:05.016310 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:05.028031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:05.108747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:05.742671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:05.762037 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-98f13082-c7f1-4d5f-957c-4163493190bc tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1314 microversion: 2.1 time: 1.113104 Jul 28 01:16:05.775941 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 161/300] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:04 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:05.780979 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:05.794434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:05.796630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:05.818276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:05.819751 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:05.820862 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:05.821583 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:05.825372 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:05.826936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:05.838297 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:05.852164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:05.853405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-92af133c-2620-4c98-afa1-557414f05b4b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.885406 Jul 28 01:16:05.853980 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 140/301] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:04 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:05.885131 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:05.885762 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:05.917193 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:05.917649 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:05.918442 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:05.918907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:05.972998 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:05.999589 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-24142fc2-8e27-46c4-b61a-2404ab527687 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1191 microversion: 2.1 time: 0.222187 Jul 28 01:16:06.000186 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 162/302] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:05 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1191 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:06.378603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:06.395754 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ac84f3ec-6deb-49f2-b853-828630ceb8d2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'create', calling method: .version_select at 0x7ff71c994f70>, body: {"keypair": {"name": "tempest-keypair-1080884589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0AQmxioWFZFXX+SLSSJO+IzmS460hlDmieKW+dWoqc2zVXzi0Jhu+4YtUWczGn7vFVkZOxEndV8+MgydIeI6mTsZR8nDUvkcG0Qjy794o2YLPZo0DCRAWd3qgoDe0Ovw=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:06.406755 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-14876fff-5e2d-4c6f-a60a-d2247e6e4e8f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1701 microversion: 2.1 time: 0.551531 Jul 28 01:16:06.408318 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 141/303] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:05 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1701 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:06.429062 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-66e986f4-34a2-4942-8a2e-537025c38d27 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:06.441944 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66e986f4-34a2-4942-8a2e-537025c38d27 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:06.448944 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66e986f4-34a2-4942-8a2e-537025c38d27 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:06.456854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-ac84f3ec-6deb-49f2-b853-828630ceb8d2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:16:06.463338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-ac84f3ec-6deb-49f2-b853-828630ceb8d2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for user 018eb80709e94d5e8653fb6eeb342c54 and project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:16:06.520507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ac84f3ec-6deb-49f2-b853-828630ceb8d2 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122748 Jul 28 01:16:06.536368 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 163/304] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:16:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:06.574363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-66e986f4-34a2-4942-8a2e-537025c38d27 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Going to try to start instance {{(pid=117960) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 01:16:06.683142 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-66e986f4-34a2-4942-8a2e-537025c38d27 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action" status: 202 len: 0 microversion: 2.1 time: 0.257232 Jul 28 01:16:06.685983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 142/305] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:16:06 2022] POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 01:16:06.695991 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:06.696612 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:06.721781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:06.722275 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:06.723173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:06.723658 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:06.788081 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:06.789305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:06.829203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:06.835533 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:06.839474 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:06.840118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:07.393664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:07.402961 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-30f858f5-ab40-430b-ac6f-6bc49b24b669 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1314 microversion: 2.1 time: 0.623525 Jul 28 01:16:07.403552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 143/306] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:06 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:07.427673 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:07.428681 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:07.438092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:07.439107 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:07.440250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:07.440972 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:07.498323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:07.511813 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9c7daaa9-78b4-4681-8aa1-559e74bc9c50 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1710 microversion: 2.1 time: 0.822615 Jul 28 01:16:07.513270 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 164/307] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:06 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1710 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:07.520465 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:07.521652 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:07.542707 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:07.543640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:07.546462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:07.547681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:08.085611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:08.110597 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73f4ea83-d464-417f-93bb-40b80fc9ebe2 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1197 microversion: 2.1 time: 0.589151 Jul 28 01:16:08.113684 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 165/308] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:07 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1197 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:08.133765 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-81362f67-79b2-4cb2-8563-8e7bf0915bf7 req-dbc405cc-23bd-4550-9266-f32a45289609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0adff266-7f29-4fd6-9852-05c6bafae8e3", "name": "network-vif-plugged", "status": "completed", "tag": "7aca7690-85ad-4c74-8cea-1f48979942ea"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:08.151044 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-81362f67-79b2-4cb2-8563-8e7bf0915bf7 req-dbc405cc-23bd-4550-9266-f32a45289609 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:08.151810 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-81362f67-79b2-4cb2-8563-8e7bf0915bf7 req-dbc405cc-23bd-4550-9266-f32a45289609 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:08.164227 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-81362f67-79b2-4cb2-8563-8e7bf0915bf7 req-dbc405cc-23bd-4550-9266-f32a45289609 service nova] Creating event network-vif-plugged:7aca7690-85ad-4c74-8cea-1f48979942ea for instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 on hv-cinder-81558 Jul 28 01:16:08.170293 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-81362f67-79b2-4cb2-8563-8e7bf0915bf7 req-dbc405cc-23bd-4550-9266-f32a45289609 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054924 Jul 28 01:16:08.171328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 166/309] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:08.183054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:08.192243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:08.193750 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:08.197653 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0eff3320-7369-4e40-99d6-851bbd2edf16 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.783537 Jul 28 01:16:08.198454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 144/310] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:07 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:08.427440 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:08.428473 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:08.440646 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:08.441383 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:08.446770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:08.447416 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:08.540110 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:08.541932 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:08.554273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:08.555201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:08.559347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:08.560013 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:08.799984 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:08.812058 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7218a20a-1580-4d71-a727-b9cfdfdfe0a6 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1314 microversion: 2.1 time: 0.390076 Jul 28 01:16:08.812713 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 167/311] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:08 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:08.839994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1349693088", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f65178e-aa89-435c-9fed-639dfc5bec3f"}], "security_groups": [{"name": "tempest-securitygroup--1705610214"}], "key_name": "tempest-keypair-1080884589", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:08.885934 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:08.894694 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d8dd17f3-dea7-48c9-be4a-09255c848863 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1710 microversion: 2.1 time: 0.358382 Jul 28 01:16:08.898971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 145/312] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:08 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1710 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:08.974674 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] validate_networks() for [('8f65178e-aa89-435c-9fed-639dfc5bec3f', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:16:09.133764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:09.133764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:09.140110 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.143314 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.145299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.145912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.387587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:09.399328 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d2e9b22b-4eb2-4d76-909c-dbc7a426355b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.270838 Jul 28 01:16:09.400776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 146/313] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:09 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:09.407821 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:09.408663 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:09.415280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.415989 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.416936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.417543 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.605754 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:16:09.606172 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:16:09.606660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:16:09.607080 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:16:09.607488 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:16:09.622150 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.622891 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.623851 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.624550 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.644982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:16:09.649499 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Getting quotas for user 018eb80709e94d5e8653fb6eeb342c54 and project af4689d2f0ef4d71a1c465610011f2d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:16:09.651398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:09.662895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:09.663807 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:16:09.665473 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:09.666493 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:16:09.667046 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-35acb967-cf27-45cb-8052-7e12e24d3e41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.265179 Jul 28 01:16:09.668130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 147/314] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:09 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:09.717017 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a6c0fae-a6ad-4b5d-9aa9-8498dd5d10a9 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.893028 Jul 28 01:16:09.723528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 168/315] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:16:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:16:09.728636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-160ae50b-6718-46ee-9a24-a6c689a53765 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:09.729500 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-160ae50b-6718-46ee-9a24-a6c689a53765 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:09.806818 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-160ae50b-6718-46ee-9a24-a6c689a53765 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:09.814137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-160ae50b-6718-46ee-9a24-a6c689a53765 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1246 microversion: 2.1 time: 0.089285 Jul 28 01:16:09.821988 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 148/316] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:09 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:09.842450 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:09.843423 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:09.853611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.854338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.855326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.855911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.863741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:09.916888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:09.917581 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:09.924357 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.924896 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:09.925752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:09.926251 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:10.103258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:10.117326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f2aaa2eb-e1dc-4740-b5bd-c6b2fab23975 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1314 microversion: 2.1 time: 0.279651 Jul 28 01:16:10.119574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 169/317] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:09 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:10.150953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:10.160941 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c0b7eddd-b44a-4129-a8d3-78e94521109a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1710 microversion: 2.1 time: 0.247817 Jul 28 01:16:10.161822 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 149/318] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:09 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1710 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:10.424427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:10.425492 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:10.435612 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:10.436610 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:10.437617 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:10.438329 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:10.595232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:10.608161 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a1642bea-86d6-4386-899c-158e3c2e034a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.187751 Jul 28 01:16:10.608767 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 170/319] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:10 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:10.694875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:10.694875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:10.697519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:10.697990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:10.698754 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:10.699222 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:10.838228 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:10.839803 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:10.849337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:10.851175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:10.852329 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:10.852944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:11.035078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:11.058418 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8eaf576-284e-4a62-b81d-c1b2daea75e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1250 microversion: 2.1 time: 0.223801 Jul 28 01:16:11.069208 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 171/320] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:10 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1250 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:11.146332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:11.147442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:11.161723 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:11.175604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:11.176578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:11.177090 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:11.300739 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:11.329750 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:11.335621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:11.337393 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b4c98312-6c1f-4a17-a290-315fc34e71c1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.650774 Jul 28 01:16:11.352351 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 150/321] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:10 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:16:11.376524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:11.377523 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:11.390486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:11.392123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:11.394223 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:11.395207 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:11.589068 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:11.603169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7e82d623-0c81-4a8f-9303-83461fdf926d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1314 microversion: 2.1 time: 0.465137 Jul 28 01:16:11.616714 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 172/322] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:11 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:11.629179 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:11.630501 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:11.638216 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:11.638881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:11.639933 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:11.640814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:11.856532 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:11.873725 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b3b0183f-0a0f-44fe-a06b-cc59a84a0769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1710 microversion: 2.1 time: 0.520025 Jul 28 01:16:11.876133 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 151/323] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:11 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1710 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:11.996838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:12.007018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b4955f3c-f8ca-42df-9b27-848a4415b6e9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.381509 Jul 28 01:16:12.020682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 173/324] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:11 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:12.093755 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:12.094755 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:12.111959 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.112410 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.113269 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.113636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.228726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:12.238244 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8516f776-83d7-4797-9c07-8fbaab05c6e6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1298 microversion: 2.1 time: 0.149631 Jul 28 01:16:12.252951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 152/325] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:12 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:12.356135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-ea4818f9-ded4-42e0-90a2-07f60e2e5a40 req-f79318d6-d034-47dd-afd2-a5dfb1672cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aad030-b12c-409b-b5da-ba6eb7779f32", "tag": "1e3d4ead-cc70-43f5-a886-471d0c3f9868"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:12.366306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:12.367157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:12.378764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.379337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.379669 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ea4818f9-ded4-42e0-90a2-07f60e2e5a40 req-f79318d6-d034-47dd-afd2-a5dfb1672cff service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.380853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ea4818f9-ded4-42e0-90a2-07f60e2e5a40 req-f79318d6-d034-47dd-afd2-a5dfb1672cff service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.387889 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.388926 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.407477 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-ea4818f9-ded4-42e0-90a2-07f60e2e5a40 req-f79318d6-d034-47dd-afd2-a5dfb1672cff service nova] Creating event network-changed:1e3d4ead-cc70-43f5-a886-471d0c3f9868 for instance 49aad030-b12c-409b-b5da-ba6eb7779f32 on hv-cinder-81558 Jul 28 01:16:12.420882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-ea4818f9-ded4-42e0-90a2-07f60e2e5a40 req-f79318d6-d034-47dd-afd2-a5dfb1672cff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068967 Jul 28 01:16:12.421846 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 174/326] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:12.624563 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:12.625659 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:12.636214 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.637935 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.639603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.641143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.677334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:12.690121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:12.693288 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:12.694678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c90a9212-169f-4aa1-bf10-c1b40c5da717 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1744 microversion: 2.20 time: 0.332408 Jul 28 01:16:12.696134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 153/327] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:12 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1744 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:12.844558 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:12.852286 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1b208d98-ada8-41a4-a5c7-0eaf0693214b tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1497 microversion: 2.1 time: 0.232372 Jul 28 01:16:12.867460 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 175/328] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:12 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:12.901338 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:12.902198 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:12.916799 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.917847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:12.918712 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:12.919184 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.028859 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:13.029430 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:13.039615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.041042 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.042198 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.046401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.446810 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:13.457100 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-92c4120b-1fad-4bd3-8d40-e29f570b5b51 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1710 microversion: 2.1 time: 0.560055 Jul 28 01:16:13.457942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 154/329] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:12 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1710 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:13.463182 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:13.464040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:13.472277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.472894 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.473695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.474133 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.563560 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:13.570211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:13.573349 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ceb755f1-0f32-4830-85ba-9db71f2e45d7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1304 microversion: 2.1 time: 0.114233 Jul 28 01:16:13.574125 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 155/330] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:13 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:13.593110 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cdfe4ad7-05ce-4b23-acc5-ea5e1b5c444d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.568396 Jul 28 01:16:13.594234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 176/331] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:13 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:13.645810 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:13.653844 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:13.654402 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:13.672332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.676572 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.677461 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.677898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.711128 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:16:13.723274 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:13.724788 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:13.728784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:13.732357 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.733003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.733944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.735776 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.813473 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d13ea8d0-327d-4e8f-8feb-64e5b4cea30d tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 204 len: 0 microversion: 2.1 time: 0.167929 Jul 28 01:16:13.814724 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 156/332] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:16:13 2022] DELETE /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:16:13.825264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:13.826406 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:13.840368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.842636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:13.843651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:13.844842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:14.329825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:14.338618 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:14.340460 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:14.341818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-88ec7b17-ee31-4c57-ba30-55a47348c44b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1744 microversion: 2.20 time: 0.622657 Jul 28 01:16:14.359783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:14.360692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 177/333] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:13 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1744 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:14.369333 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-eb3d3560-3342-4cc1-9a0c-d1f0de20c66f tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1503 microversion: 2.1 time: 0.549178 Jul 28 01:16:14.370535 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 157/334] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:13 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:14.482469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:14.483990 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:14.492490 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:14.493864 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:14.494905 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:14.495431 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:14.599906 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:14.601015 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:14.610365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:14.611476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:14.612462 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:14.612893 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:14.716795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:14.728785 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6972463a-ee54-42a6-a2c7-17b88f6e5753 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1304 microversion: 2.1 time: 0.132570 Jul 28 01:16:14.743273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 158/335] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:14 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:14.748574 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:14.749185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:14.767123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:14.769534 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:14.771460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:14.772370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:14.888041 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:14.912441 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4e84ee8f-132d-47ea-b103-7445ffd01468 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1714 microversion: 2.1 time: 0.435877 Jul 28 01:16:14.926711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 178/336] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:14 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1714 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:14.949763 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-a52cbe9a-9c7a-403a-8a20-2068ae874ef8 req-4dd47cdf-fa83-478c-b5dd-cf2aae9817ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300e3c0c-fb14-4c05-b53a-fe8f0589ac1b", "name": "network-vif-plugged", "status": "completed", "tag": "a76b2846-749f-47c3-81f3-a7c5328f00ad"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:14.968503 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a52cbe9a-9c7a-403a-8a20-2068ae874ef8 req-4dd47cdf-fa83-478c-b5dd-cf2aae9817ef service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:14.969245 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a52cbe9a-9c7a-403a-8a20-2068ae874ef8 req-4dd47cdf-fa83-478c-b5dd-cf2aae9817ef service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:15.007541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-a52cbe9a-9c7a-403a-8a20-2068ae874ef8 req-4dd47cdf-fa83-478c-b5dd-cf2aae9817ef service nova] Creating event network-vif-plugged:a76b2846-749f-47c3-81f3-a7c5328f00ad for instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b on hv-cinder-81558 Jul 28 01:16:15.058746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-a52cbe9a-9c7a-403a-8a20-2068ae874ef8 req-4dd47cdf-fa83-478c-b5dd-cf2aae9817ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130301 Jul 28 01:16:15.060035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 179/337] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:15.294457 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:15.307016 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8faadbed-6640-4b11-8ba6-fa2b23a75595 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.562180 Jul 28 01:16:15.308709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 159/338] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:14 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:15.372034 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:15.373088 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:15.387173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:15.390184 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:15.391654 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:15.392096 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:15.393923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:15.394645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:15.405925 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:15.406653 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:15.407778 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:15.408312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:15.980949 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:15.997556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fb0f5bb8-34b7-4048-b437-87d2cf139fc2 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1503 microversion: 2.1 time: 0.607705 Jul 28 01:16:16.011422 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 160/339] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:15 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1503 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:16.011422 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:16.011422 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:16.038317 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:16.060720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:16.065203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:16.075079 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:16.075824 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:16.080634 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:16.086947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:16.093003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-164b13fb-0391-48e7-93cb-c37255eb5446 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.725393 Jul 28 01:16:16.114408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 180/340] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:15 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:16.223579 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-35f072c6-6fce-4032-8667-661fe2ce8e0c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Action: 'create', calling method: .version_select at 0x7ff71c753a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-854569229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1RZbZ9xLq0Wfg/o8Y/BXNX6xbn75Q7YAZ3OX7gLK3Z70PTKLJdAo84Tq/bEsfGgG1h1TXJ8zht88+3G73TUKL7g/+qPLYHA2VVfypUG1z/OHjRbbexE5T18NRrv0Ebmw=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:16.240022 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-35f072c6-6fce-4032-8667-661fe2ce8e0c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Getting quotas for project 9889594f4bf84c4591714b505f1861fe. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:16:16.265140 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-35f072c6-6fce-4032-8667-661fe2ce8e0c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Getting quotas for user 70b75ae15822428f916c3403f9a67225 and project 9889594f4bf84c4591714b505f1861fe. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:16:16.329237 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-35f072c6-6fce-4032-8667-661fe2ce8e0c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.108558 Jul 28 01:16:16.331841 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 181/341] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:16:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:16.353940 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:16.358244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:16.394370 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:16.400321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:16.407836 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:16.408546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:16.751560 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:16.762643 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e8aed3ac-abfd-47da-9c71-1a9d6aa70027 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.763089 Jul 28 01:16:16.763876 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 161/342] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:15 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:16.784259 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-da3d6171-314e-44de-973e-d7b8b55a0078 req-d979c6ab-920f-43f0-a447-6f5a4353ca21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0adff266-7f29-4fd6-9852-05c6bafae8e3", "name": "network-vif-deleted", "tag": "7aca7690-85ad-4c74-8cea-1f48979942ea"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:16.803701 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-da3d6171-314e-44de-973e-d7b8b55a0078 req-d979c6ab-920f-43f0-a447-6f5a4353ca21 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:16.804460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-da3d6171-314e-44de-973e-d7b8b55a0078 req-d979c6ab-920f-43f0-a447-6f5a4353ca21 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:16.819419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-da3d6171-314e-44de-973e-d7b8b55a0078 req-d979c6ab-920f-43f0-a447-6f5a4353ca21 service nova] Creating event network-vif-deleted:7aca7690-85ad-4c74-8cea-1f48979942ea for instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 on hv-cinder-81558 Jul 28 01:16:16.825471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-da3d6171-314e-44de-973e-d7b8b55a0078 req-d979c6ab-920f-43f0-a447-6f5a4353ca21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060250 Jul 28 01:16:16.831465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 162/343] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:16.838907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2055876153", "imageRef": "dd0b0c8b-80b1-4720-81a5-81dc8e0e3a06", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-854569229", "networks": [{"uuid": "3896987d-a99e-4647-8e6b-6bfb34b8ea7a"}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:16.864027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:16.873483 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dfeec727-46a7-43da-a006-0268a333843c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.540039 Jul 28 01:16:16.874082 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 182/344] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:16 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:16.933158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] validate_networks() for [('3896987d-a99e-4647-8e6b-6bfb34b8ea7a', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:16:17.033351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:17.035569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:17.053601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:17.055687 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:17.058146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:17.059909 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:17.165494 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:17.166231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:17.167004 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lazy-loading 'fault' on Instance uuid 0adff266-7f29-4fd6-9852-05c6bafae8e3 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:16:17.306949 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f128878c21545e9aef8d9f9cb7b6881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beae1c88e9948d28a386b5e31c68f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:17.331460 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-144478ea-f3b2-49a7-8193-0625d79c2e02 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 200 len: 1304 microversion: 2.1 time: 0.312008 Jul 28 01:16:17.333419 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 183/345] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:17 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 1304 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:17.347212 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:17.348877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:17.357559 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:17.358635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:17.359761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:17.360365 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:17.950709 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:17.978192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:17.983655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:17.987227 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ab9b01ce-f6d4-493d-8c67-41449145d52b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.650207 Jul 28 01:16:17.990049 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 184/346] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:17 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:17.997679 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:17.998579 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:18.007518 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.008228 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.009382 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.009970 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.550448 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:16:18.551531 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:16:18.552121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:16:18.552638 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:16:18.553373 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:16:18.566135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.566706 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.567633 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.568312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.589690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Getting quotas for project 9889594f4bf84c4591714b505f1861fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:16:18.595694 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Getting quotas for user 70b75ae15822428f916c3403f9a67225 and project 9889594f4bf84c4591714b505f1861fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:16:18.612251 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:16:18.615537 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd0b0c8b-80b1-4720-81a5-81dc8e0e3a06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:16:18.629314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:18.642465 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d2fe8ab7-ef65-4fdd-a522-05e8fff3dfd7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.648974 Jul 28 01:16:18.643076 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 185/347] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:17 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:18.647665 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:18.649434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:18.655853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.656523 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.663231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.663990 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.708397 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-de130c03-44f8-4a23-8d99-fcc3784a6ea1 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875379 Jul 28 01:16:18.709486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 163/348] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:16:18.714609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:18.715517 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] [instance: 0adff266-7f29-4fd6-9852-05c6bafae8e3] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:18.723432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.724228 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.725205 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:18.725827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:18.743918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] HTTP exception thrown: Instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 could not be found. Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Request method failure captured: Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 HTTP/1.1 Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eMwbMKnah8pgAqfH_CyZWiFAGPsy4dmMREHVitxZHWrTnkSGarzr-1A6GwHPfR1XBIs-CmUJ1HlDYTGjy4rrvxfgqTkhQIorVOlQl-qqRrZiJXEqwclifQCMNs5LpkU5L2Fy8hWdhR7xlzU0Xg9ZKDH-1QL5wGtDjCsxmUMlnGfLGk Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: 0beae1c88e9948d28a386b5e31c68f85 Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-VolumesActionsTest-1672736751 Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:16:18.745939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0beae1c88e9948d28a386b5e31c68f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0beae1c88e9948d28a386b5e31c68f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0beae1c88e9948d28a386b5e31c68f85", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0beae1c88e9948d28a386b5e31c68f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-VolumesActionsTest-1672736751 Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: 0beae1c88e9948d28a386b5e31c68f85 Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-VolumesActionsTest-1672736751 Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-VolumesActionsTest-1672736751-project Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 6f128878c21545e9aef8d9f9cb7b6881 Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-VolumesActionsTest-1672736751-project Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 could not be found. Jul 28 01:16:18.747355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '0adff266-7f29-4fd6-9852-05c6bafae8e3'} Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 could not be found. Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:16:18.748152 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 could not be found. Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 could not be found. Jul 28 01:16:18.752508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:16:18.755352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] Returning 404 to user: Instance 0adff266-7f29-4fd6-9852-05c6bafae8e3 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:16:18.756478 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-08ab8da0-0565-4b10-901f-2be61672f6a9 tempest-VolumesActionsTest-1672736751 tempest-VolumesActionsTest-1672736751-project] 10.222.0.17 "GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3" status: 404 len: 111 microversion: 2.1 time: 0.045676 Jul 28 01:16:18.757523 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 164/349] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:18 2022] GET /compute/v2.1/servers/0adff266-7f29-4fd6-9852-05c6bafae8e3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:16:18.773347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-740ac1ed-08f0-4025-8d56-3a1a3d0d6b3c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:18.774170 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-740ac1ed-08f0-4025-8d56-3a1a3d0d6b3c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:18.971441 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-740ac1ed-08f0-4025-8d56-3a1a3d0d6b3c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:18.979437 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-740ac1ed-08f0-4025-8d56-3a1a3d0d6b3c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1258 microversion: 2.1 time: 0.220707 Jul 28 01:16:18.983440 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 165/350] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:18 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:18.994310 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-8c21da20-ce01-4ffe-a20d-73d25e1afa21 req-bf10064b-1ce5-4f0f-aa34-c779cc1d6fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52389b09-fdf8-4c6d-8e9d-474a6f793cf4", "tag": "67c0b2f9-537a-48fb-8cc7-ee1426299bf2"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:19.015136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8c21da20-ce01-4ffe-a20d-73d25e1afa21 req-bf10064b-1ce5-4f0f-aa34-c779cc1d6fa9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:19.015947 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8c21da20-ce01-4ffe-a20d-73d25e1afa21 req-bf10064b-1ce5-4f0f-aa34-c779cc1d6fa9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:19.050972 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-8c21da20-ce01-4ffe-a20d-73d25e1afa21 req-bf10064b-1ce5-4f0f-aa34-c779cc1d6fa9 service nova] Creating event network-changed:67c0b2f9-537a-48fb-8cc7-ee1426299bf2 for instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 on hv-cinder-81558 Jul 28 01:16:19.065670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-8c21da20-ce01-4ffe-a20d-73d25e1afa21 req-bf10064b-1ce5-4f0f-aa34-c779cc1d6fa9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080876 Jul 28 01:16:19.069335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 166/351] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:19.083216 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:19.083919 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:19.095636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:19.104621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:19.105068 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:19.105844 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:19.106271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:19.208551 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:19.222714 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c3a2416b-8b3d-45d7-ab17-bd8fcb01983d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.578545 Jul 28 01:16:19.236308 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 186/352] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:18 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:19.573956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:19.590074 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:19.591747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:19.593192 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d9bbc181-f3f4-4cac-8e81-75803503a5ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.520746 Jul 28 01:16:19.611149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 167/353] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:19 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:19.668193 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:19.669140 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:19.679122 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:19.683888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:19.684924 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:19.686606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:19.687244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:20.001374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:20.005575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:20.008964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:20.009764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:20.012964 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c0256e91-18f7-430e-a69f-08a3ab0a5f45 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.350523 Jul 28 01:16:20.014466 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 187/354] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:19 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:20.018672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:20.019659 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:20.022483 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:20.024453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:20.120927 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:20.132317 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-57e38fba-3393-4d27-8c7a-2f05a624076c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1254 microversion: 2.1 time: 0.128973 Jul 28 01:16:20.133655 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 168/355] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:20 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1254 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:20.254569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:20.258032 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:20.274656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:20.277089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:20.279257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:20.280487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:20.527378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:20.534447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-695ccd0c-a032-4442-86c0-1599e580e2e8 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.291856 Jul 28 01:16:20.535083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 188/356] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:20 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:20.624080 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:20.624877 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:20.632644 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:20.633386 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:20.634343 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:20.634955 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:20.798827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:20.809426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:20.811430 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:20.812732 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b59ad225-e2d8-4af2-b660-b09d75fd8242 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.196167 Jul 28 01:16:20.813290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 169/357] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:20 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:21.040292 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:21.040980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:21.047618 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.048051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:21.048955 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.049367 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:21.154987 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:21.155864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:21.168103 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.168790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:21.170279 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.170941 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:21.210434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:21.220101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9293498b-54bd-44fd-ad4d-c18a82a96a42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.184324 Jul 28 01:16:21.237063 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 189/358] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:21 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:21.239181 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:21.247070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c2d74a6a-92b8-4430-9437-e6b9fc10dd69 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1254 microversion: 2.1 time: 0.096114 Jul 28 01:16:21.247872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 170/359] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:21 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1254 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:21.568054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:21.569349 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:21.575852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.576484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:21.577434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.578005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:21.738942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:21.752418 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3ace9ab3-5a21-407c-abfa-1ae9a78ac6d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.189505 Jul 28 01:16:21.753071 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 190/360] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:21 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:21.843928 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:21.844520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:21.851567 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.851996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:21.852960 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:21.853546 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:22.006775 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:22.017054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:22.018802 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:22.020203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-65993718-75b5-40de-af8f-7f1274078c6a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.180286 Jul 28 01:16:22.020755 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 171/361] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:21 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:22.241277 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:22.241886 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:22.248926 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:22.249373 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:22.250267 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:22.250673 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:22.268967 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:22.269565 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:22.278371 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:22.279374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:22.280329 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:22.280907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:22.360793 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:22.369052 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-75042552-6483-4b32-8c09-98d6389b3c6a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1254 microversion: 2.1 time: 0.103967 Jul 28 01:16:22.369985 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 172/362] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:22 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1254 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:22.443501 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:22.461610 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e1a54cc-7849-4302-a04e-0e9bb4217336 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.224250 Jul 28 01:16:22.462756 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 191/363] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:22 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:22.773803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:22.774333 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:22.781144 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:22.781645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:22.782457 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:22.782923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:22.927727 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:22.935487 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-cd3c0910-153f-49ee-a1a6-b071fddbae6c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.165762 Jul 28 01:16:22.936048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 173/364] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:22 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:23.045860 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:23.047116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:23.054018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.054555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:23.055603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.056433 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:23.205393 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:23.216697 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:23.218392 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:23.219847 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9ef4da9d-421d-4ed8-baeb-ac83f8d98112 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.178076 Jul 28 01:16:23.220500 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 192/365] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:23 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:23.397335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:23.397956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:23.417228 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.417839 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:23.418818 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.419932 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:23.483146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:23.484005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:23.485853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:23.490574 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:23.502428 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.502908 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:23.503449 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8a73cb23-14af-4755-8340-771aac2ad49f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1254 microversion: 2.1 time: 0.113645 Jul 28 01:16:23.503698 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.504365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 174/366] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:23 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1254 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:23.522179 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:23.685266 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:23.697014 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2759542a-b8c7-4f41-8400-743d4342d99d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.216939 Jul 28 01:16:23.698271 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 193/367] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:23 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:23.957903 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:23.959622 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:23.966264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.967030 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:23.968036 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:23.968614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:24.108701 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:24.111561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:24.118809 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c1cecc34-9411-4f2c-b6af-482afb0ec19c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.164969 Jul 28 01:16:24.119912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 175/368] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:23 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:24.243486 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:24.244091 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:24.253194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:24.253416 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:24.261669 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:24.262258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:24.449517 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:24.459790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:24.462486 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:24.463755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b00aa42-468d-4c4c-88ed-8ace229d1dd1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.224219 Jul 28 01:16:24.464684 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 194/369] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:24 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:24.525292 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:24.525911 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:24.535853 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:24.536340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:24.537145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:24.537583 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:24.659039 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:24.672783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a2f3d94e-4ac2-47b3-b5d3-15156f6a37dd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1254 microversion: 2.1 time: 0.148858 Jul 28 01:16:24.675008 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 176/370] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:24 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1254 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:24.720453 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:24.721167 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:24.733815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:24.734436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:24.736334 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:24.740251 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:25.084591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:25.095217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4bf8a660-3e52-4d62-bcf7-7b407b364093 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.376900 Jul 28 01:16:25.095849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 195/371] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:24 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:25.140780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:25.141395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:25.154870 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:25.155498 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:25.163873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:25.164438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:25.489473 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:25.490768 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:25.499192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:25.500193 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:25.501153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:25.502051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:25.581851 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:25.590461 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-26e34a95-0c2e-4cdf-a946-275da9227da5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.453547 Jul 28 01:16:25.595708 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 177/372] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:25 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:25.696683 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:25.697799 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:25.715238 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:25.715981 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:25.720671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:25.723405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:25.915393 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:25.927188 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-66c4be89-78e7-43d3-a1d4-d2f783f8bf77 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1316 microversion: 2.1 time: 0.235398 Jul 28 01:16:25.929612 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 178/373] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:25 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:26.119553 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:26.121484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:26.136092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:26.136949 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:26.137993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:26.138662 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:26.241734 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:26.257894 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:26.284046 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:26.285776 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-781ba4d1-2ef4-40c0-ac7a-5ac83bf4c941 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.801539 Jul 28 01:16:26.295692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 196/374] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:25 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:26.618534 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:26.620053 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:26.627956 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=22 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:26.638378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:26.639305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:26.641643 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:26.641643 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:27.082237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:27.086300 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:27.099926 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f1ddd929-da18-46cc-8884-88ba3d1e17da tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.482123 Jul 28 01:16:27.101093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 197/375] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:26 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:27.102618 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d77f3e96-5a9f-4749-baf9-f225e217b7db tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.987037 Jul 28 01:16:27.113133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:27.115590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:27.126916 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:27.129290 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:27.133345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 179/376] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:26 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:27.134480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:27.136759 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:27.355844 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:27.356656 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:27.378558 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:27.380937 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:27.383995 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:27.386695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:27.428156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:27.454646 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-820c8ed2-ff2b-480a-a502-cc0a585e500a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.352175 Jul 28 01:16:27.458941 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 198/377] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:27 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:27.894669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:27.904042 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:27.908270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:27.909681 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c6d4a48a-b89b-4636-8979-62de0e84dbb5 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.559425 Jul 28 01:16:27.910747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 180/378] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:27 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:28.122187 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:28.123424 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:28.135565 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:28.136947 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:28.145591 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:28.147832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:28.148563 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:28.149578 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:28.150249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:28.153578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:28.154264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:28.155135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:28.578737 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:28.977109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=18 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:29.154346 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:29.172921 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fbcde866-9806-41eb-87c9-1d857414ad4b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 1.041110 Jul 28 01:16:29.177499 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 181/379] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:28 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:29.186563 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:29.187985 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:29.224419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:29.225237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:29.227280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:29.227888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:29.330622 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:29.344397 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bde56013-6443-422b-a614-cdcd201c2bd5 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 1.226469 Jul 28 01:16:29.361479 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 199/380] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:28 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:29.370543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:29.371372 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:29.383837 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:29.384556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:29.385723 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:29.386821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:30.006215 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:30.018264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9ef79992-e2d7-4e3e-93ce-456ff8b686af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.839402 Jul 28 01:16:30.019552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 182/381] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:29 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:30.081717 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:30.096819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:30.103340 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:30.108970 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-730dfcb7-8cc0-46b1-a98e-d676a07e7917 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1739 microversion: 2.20 time: 0.743299 Jul 28 01:16:30.134691 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 200/382] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:29 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1739 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:30.206580 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:30.218623 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:30.245230 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-3d853cf5-c129-424e-8a55-3049411b0a53 req-281ec564-7543-4f00-b041-0a84e25f3263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c015e542-38ce-4335-bfa4-f9c77444f42f", "tag": "6f17787d-ed77-4892-b415-19e790741366"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:30.283254 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3d853cf5-c129-424e-8a55-3049411b0a53 req-281ec564-7543-4f00-b041-0a84e25f3263 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:30.283791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3d853cf5-c129-424e-8a55-3049411b0a53 req-281ec564-7543-4f00-b041-0a84e25f3263 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:30.301559 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:30.302024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:30.302995 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:30.306176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:30.330369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-3d853cf5-c129-424e-8a55-3049411b0a53 req-281ec564-7543-4f00-b041-0a84e25f3263 service nova] Creating event network-changed:6f17787d-ed77-4892-b415-19e790741366 for instance c015e542-38ce-4335-bfa4-f9c77444f42f on hv-cinder-81558 Jul 28 01:16:30.348370 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-3d853cf5-c129-424e-8a55-3049411b0a53 req-281ec564-7543-4f00-b041-0a84e25f3263 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107771 Jul 28 01:16:30.350018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 201/383] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:30.370161 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:30.371592 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:30.387594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:30.388069 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:30.389082 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:30.390026 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:30.875874 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:30.917840 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:30.919237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-343294a7-0bc5-436b-9c68-4c41ec5757ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.716144 Jul 28 01:16:30.935123 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-89e6f0c3-3ba9-48e8-aca0-50b4b2e5a587 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.560321 Jul 28 01:16:30.937977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 183/384] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:30 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:30.949794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 202/385] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:30 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:31.044145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:31.045281 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:31.055584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:31.056306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:31.057268 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:31.057854 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:31.138994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:31.140954 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:31.161488 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:31.161960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:31.168183 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:31.170635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:31.702967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:31.715815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:31.726196 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:31.728530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b88fa889-aa42-4140-ab53-19260e68ea8a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.597016 Jul 28 01:16:31.734493 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 203/386] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:31 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:31.756129 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-5aa341fc-89b1-4de5-b2f3-fa5cfd368f54 req-cb958fd1-0093-4360-8b40-47bbfe87be90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52389b09-fdf8-4c6d-8e9d-474a6f793cf4", "name": "network-vif-plugged", "status": "completed", "tag": "67c0b2f9-537a-48fb-8cc7-ee1426299bf2"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:31.796160 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5aa341fc-89b1-4de5-b2f3-fa5cfd368f54 req-cb958fd1-0093-4360-8b40-47bbfe87be90 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:31.797612 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5aa341fc-89b1-4de5-b2f3-fa5cfd368f54 req-cb958fd1-0093-4360-8b40-47bbfe87be90 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:31.830291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-5aa341fc-89b1-4de5-b2f3-fa5cfd368f54 req-cb958fd1-0093-4360-8b40-47bbfe87be90 service nova] Creating event network-vif-plugged:67c0b2f9-537a-48fb-8cc7-ee1426299bf2 for instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 on hv-cinder-81558 Jul 28 01:16:31.846658 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-5aa341fc-89b1-4de5-b2f3-fa5cfd368f54 req-cb958fd1-0093-4360-8b40-47bbfe87be90 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109889 Jul 28 01:16:31.847848 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 204/387] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:31.952761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:31.953882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:31.966638 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:31.967531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:31.968616 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:31.969301 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:32.132672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:32.152798 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8b40828d-ea20-4e5d-9990-7aaf4c2733af tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 1.113700 Jul 28 01:16:32.179511 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 184/388] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:31 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:32.191714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:32.193611 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:32.209687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:32.212615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:32.214585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:32.216318 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:32.525973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:32.530379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:32.545256 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-465b5402-e07c-42e1-bf9e-f59013673a7f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.596398 Jul 28 01:16:32.547001 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 205/389] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:31 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:32.633747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:32.661055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7538ef3c-493b-4bad-8c6a-020d15a33ac6 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.479819 Jul 28 01:16:32.662518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 185/390] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:32 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:32.763306 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:32.764044 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:32.771083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:32.771715 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:32.772665 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:32.773573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:33.183407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:33.184703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:33.191649 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:33.192396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:33.193347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:33.193956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:33.201859 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:33.226994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:33.228776 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:33.235805 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f34bb2db-db67-46b1-b66e-d59585fba37d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.476990 Jul 28 01:16:33.236677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 206/391] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:32 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:33.402477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:33.414915 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1bd9f806-dc07-441f-bc68-fdd39b66c0bc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.234255 Jul 28 01:16:33.429345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 186/392] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:33 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:33.568449 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:33.569483 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:33.580329 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:33.586567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:33.591247 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:33.595637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:33.694118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:33.695561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:33.718393 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:33.724856 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:33.728766 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:33.730545 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:34.017264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:34.020309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:34.029896 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3d91caa2-aa5f-4ef5-8c2f-50982eb5b676 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.465552 Jul 28 01:16:34.031026 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 207/393] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:33 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:34.032733 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c0a8ce95-d0ac-4b11-9770-71fb7f0ecedb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.344045 Jul 28 01:16:34.033637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 187/394] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:33 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:34.049570 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-5f1cd94d-66f1-403a-aa4c-f1c8d2f27e0a req-4111c5f0-993f-4178-802f-f4cb6bf09211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aad030-b12c-409b-b5da-ba6eb7779f32", "name": "network-vif-plugged", "status": "completed", "tag": "1e3d4ead-cc70-43f5-a886-471d0c3f9868"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:34.060992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5f1cd94d-66f1-403a-aa4c-f1c8d2f27e0a req-4111c5f0-993f-4178-802f-f4cb6bf09211 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:34.061773 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5f1cd94d-66f1-403a-aa4c-f1c8d2f27e0a req-4111c5f0-993f-4178-802f-f4cb6bf09211 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:34.075945 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-5f1cd94d-66f1-403a-aa4c-f1c8d2f27e0a req-4111c5f0-993f-4178-802f-f4cb6bf09211 service nova] Creating event network-vif-plugged:1e3d4ead-cc70-43f5-a886-471d0c3f9868 for instance 49aad030-b12c-409b-b5da-ba6eb7779f32 on hv-cinder-81558 Jul 28 01:16:34.082463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-5f1cd94d-66f1-403a-aa4c-f1c8d2f27e0a req-4111c5f0-993f-4178-802f-f4cb6bf09211 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050184 Jul 28 01:16:34.083448 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 208/395] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:34.268329 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:34.269998 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:34.287841 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:34.290790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:34.295109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:34.296334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:34.438724 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:34.443046 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:34.488401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:34.490291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:34.501568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:34.505148 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:34.904073 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:34.920641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:34.922294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:34.923526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e4ea464e-1f7c-46b0-afff-4f9b627c7a36 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.661782 Jul 28 01:16:34.925225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:34.933366 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2c72af42-5a8d-4f20-a4e5-8fa370d6b09f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.499756 Jul 28 01:16:34.934371 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 188/396] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:34 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:34.948866 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 209/397] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:34 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:35.052711 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:35.053335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:35.055671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:35.057292 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:35.062914 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.063375 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:35.064168 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.064604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:35.072317 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.073099 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:35.073996 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.075655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:35.391299 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:35.399459 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d8ea8ad2-9ebd-49ca-8947-e7bde7701e1e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.349366 Jul 28 01:16:35.420039 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:35.426929 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 210/398] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:35 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:35.428811 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e28ea24d-ece8-4633-9097-940e50b8b5a9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.381129 Jul 28 01:16:35.429884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 189/399] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:35 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:35.955063 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:35.955669 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:35.963585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:35.964454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:35.970778 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.974370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.975065 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:35.975834 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.976536 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:35.977662 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:35.978091 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:35.982924 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:36.192072 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:36.207049 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-91deced9-f827-4d0f-965d-7e9e59758098 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.255466 Jul 28 01:16:36.208559 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 211/400] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:35 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:36.214673 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:36.221759 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-59c5690c-d33a-43ee-9c0a-b3449acba2a5 req-9c47617c-4e43-4b27-b55d-338f6e6bb75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300e3c0c-fb14-4c05-b53a-fe8f0589ac1b", "name": "network-vif-unplugged", "status": "completed", "tag": "a76b2846-749f-47c3-81f3-a7c5328f00ad"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:36.229962 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:36.232811 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:36.234976 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-949d4588-5428-4967-878c-2b7b51ebe1a0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.275248 Jul 28 01:16:36.245832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 190/401] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:35 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:36.250263 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-59c5690c-d33a-43ee-9c0a-b3449acba2a5 req-9c47617c-4e43-4b27-b55d-338f6e6bb75c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:36.254088 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-59c5690c-d33a-43ee-9c0a-b3449acba2a5 req-9c47617c-4e43-4b27-b55d-338f6e6bb75c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:36.303533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-59c5690c-d33a-43ee-9c0a-b3449acba2a5 req-9c47617c-4e43-4b27-b55d-338f6e6bb75c service nova] Creating event network-vif-unplugged:a76b2846-749f-47c3-81f3-a7c5328f00ad for instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b on hv-cinder-81558 Jul 28 01:16:36.315500 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-59c5690c-d33a-43ee-9c0a-b3449acba2a5 req-9c47617c-4e43-4b27-b55d-338f6e6bb75c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097294 Jul 28 01:16:36.324471 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 212/402] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:36.420201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:36.420825 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:36.434345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:36.443122 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:36.444155 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:36.450450 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:36.451579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:36.451706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:36.475873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:36.476683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:36.478731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:36.479447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:36.674352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:36.690393 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-da9a7977-3501-4ea3-bc48-88d2a26d94c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.273612 Jul 28 01:16:36.691597 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 191/403] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:36 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:36.749168 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:36.759755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-00ba4a6f-93d9-4e52-82ce-1d6de010f7d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.313579 Jul 28 01:16:36.761086 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 213/404] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:36 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:37.230406 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:37.231621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:37.252829 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.253403 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.254621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.262504 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:37.263911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:37.268477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.277562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.278287 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.279250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.285039 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.296935 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=100 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:37.604723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:37.619585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-af630229-0e5f-4c55-b3ed-6bf1b1d78e29 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.393632 Jul 28 01:16:37.620187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 192/405] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:37 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:37.645562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:37.656146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:37.657977 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:37.659506 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8331ccd9-8291-43b3-8f20-bfd043795e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.402340 Jul 28 01:16:37.664635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 214/406] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:37 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:37.717650 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:37.718692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:37.726355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.727204 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.728239 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.728888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.784381 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:37.784908 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:37.791274 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.791709 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.792671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:37.793527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:37.933149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:37.941518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-50bab864-9ddb-4cda-8afb-216ee7553abc tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.229217 Jul 28 01:16:37.942101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 193/407] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:37 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:38.010572 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:38.022043 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ea541659-d473-41de-aa66-543fe64934c1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.241922 Jul 28 01:16:38.027691 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 215/408] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:37 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:38.642196 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:38.643521 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:38.662212 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:38.663003 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:38.664053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:38.664496 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:38.686400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:38.689531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:38.705667 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:38.706466 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:38.707527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:38.708159 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:38.993593 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:38.997032 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:39.008466 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-735eb8fd-73d9-497e-8c9b-cc2dae66b68f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.370576 Jul 28 01:16:39.011835 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:39.027201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 194/409] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:38 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:39.029307 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:39.030695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-43b35ee5-cc43-47fc-a7de-f8cd432e5b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.351101 Jul 28 01:16:39.043658 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 216/410] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:38 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:16:39.050212 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:39.050857 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:39.054411 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:39.055446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:39.063379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:39.064116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:39.065291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:39.066005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:39.067541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:39.068021 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:39.068775 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:39.069210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:39.386867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:39.397907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-68d412da-2ca2-4c73-9833-73f3f5d1465f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.345622 Jul 28 01:16:39.399106 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 217/411] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:39 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:39.454649 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:39.466481 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4efc332e-8403-4eac-9cfd-867a0e5ab62b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.437852 Jul 28 01:16:39.467365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 195/412] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:39 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:40.038926 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:40.038926 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:40.050093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.050651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.051524 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.051952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.058684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:40.060035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:40.087465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.087920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.088752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.089191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.433112 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:40.457027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d99a7cc-6ce3-461e-b205-a74de8173017 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.426747 Jul 28 01:16:40.474692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 218/413] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:40 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:40.478951 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:40.482099 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:40.505386 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.505759 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.506558 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.507034 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.520062 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:40.534427 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:40.536364 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:40.537983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c4760a91-1d89-43e0-a17e-3730dc753c6e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.486766 Jul 28 01:16:40.549783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 196/414] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:40 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:40.555913 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:40.556832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:40.566766 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.567948 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.568918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:40.569513 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:40.823936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:40.838039 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6f742056-0b4f-4564-94e2-45b07cf7de0a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.371479 Jul 28 01:16:40.841040 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 219/415] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:40 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:40.884935 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:40.894674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e4c682b5-3a35-481d-960c-cadc3df83102 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.343277 Jul 28 01:16:40.895519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 197/416] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:40 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:41.498270 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:41.499398 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:41.513223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:41.514024 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:41.515471 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:41.516222 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:41.566543 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:41.567253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:41.586644 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:41.587156 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:41.589657 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:41.589657 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:42.131520 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:42.142809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-609a3b9c-a40d-4808-9e0e-23c294242ba9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.654374 Jul 28 01:16:42.144223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 220/417] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:41 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:42.150285 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:42.151338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:42.161332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:42.162151 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:42.163291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:42.164011 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:42.177272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:42.186451 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:42.188635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:42.189886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9ddc4ac4-574c-4245-847a-e3df676c1754 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1721 microversion: 2.20 time: 0.631168 Jul 28 01:16:42.190659 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 198/418] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:41 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1721 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:42.195012 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:42.195690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:42.202520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:42.203058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:42.203840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:42.204269 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:42.425034 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:42.434162 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8ba7f1f9-b58d-45c2-8af0-94d53af90139 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.242654 Jul 28 01:16:42.435332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 199/419] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:42 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:42.438630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:42.449435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1ecebbec-96cc-4d4e-b806-117c4a8e8fb9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.303297 Jul 28 01:16:42.450289 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 221/420] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:42 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:43.165703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:43.166326 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:43.177497 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.178222 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.179590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.180202 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.216424 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:43.217037 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:43.224626 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.225082 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.225876 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.226310 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.423191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:43.433300 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fd555b2d-b5cb-4b11-8fb9-f8a9d1b3a5d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.271610 Jul 28 01:16:43.433817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 200/421] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:43 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:43.437063 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:43.446902 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:43.448560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:43.450049 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2d59eff9-6411-4e46-b36f-54680d35d3e1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1724 microversion: 2.20 time: 0.237567 Jul 28 01:16:43.451570 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 222/422] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:43 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:43.459127 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:43.460170 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:43.466963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.467787 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.473719 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:43.474557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:43.478154 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.479486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.481996 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.482554 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.483662 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.484262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.703511 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:43.706907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:43.710742 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:43.717533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-51a466e5-7198-498c-8815-cad5e6c5d053 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.247259 Jul 28 01:16:43.718254 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 223/423] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:43 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:43.721651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0a9f6bc3-844c-4463-b3dd-61606101b6ab tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1372 microversion: 2.1 time: 0.266564 Jul 28 01:16:43.722405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 201/424] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:43 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:43.732885 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-632f68a2-0b71-4042-9ed3-3de199922e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "480ef22d-dd21-4c38-80e9-ed8fa5f11d7c"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:43.736087 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-632f68a2-0b71-4042-9ed3-3de199922e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:43.744388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-632f68a2-0b71-4042-9ed3-3de199922e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.744907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-632f68a2-0b71-4042-9ed3-3de199922e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:43.745689 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-632f68a2-0b71-4042-9ed3-3de199922e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:43.746125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-632f68a2-0b71-4042-9ed3-3de199922e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.318407 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-632f68a2-0b71-4042-9ed3-3de199922e92 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.598785 Jul 28 01:16:44.324629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 224/425] 10.222.0.17 () {62 vars in 1364 bytes} [Thu Jul 28 01:16:43 2022] POST /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments => generated 188 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:16:44.450937 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:44.452282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:44.459391 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.460107 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.461045 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.461654 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.473580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:44.474191 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:44.481218 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.481665 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.482643 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.483249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.512491 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117960) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 01:16:44.603353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2bae576a-414f-4c53-b555-18c6e69ef5fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/action" status: 202 len: 0 microversion: 2.20 time: 0.156361 Jul 28 01:16:44.604682 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 202/426] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Jul 28 01:16:44 2022] POST /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:16:44.621174 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:44.624421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:44.633137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.633582 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.634665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.634988 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.668165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:44.694397 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-09a585b9-8d5c-4122-ac70-c73f9ea2f633 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.224585 Jul 28 01:16:44.696707 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 225/427] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:44 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:44.738643 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:44.740786 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:44.748054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.748592 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.749826 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.750355 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.822247 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:44.837040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:44.838525 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:44.839723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8f267caa-f5a8-4753-b2a4-cc823cb803b2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1810 microversion: 2.20 time: 0.230761 Jul 28 01:16:44.850876 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 203/428] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:44 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:44.857655 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:44.858267 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:44.866452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.866931 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:44.867703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:44.868136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:45.030465 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:45.039527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-296355ff-bb27-47d1-96b5-9116f9399d97 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1265 microversion: 2.1 time: 0.305164 Jul 28 01:16:45.046966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 226/429] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:44 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:16:45.098365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:45.108427 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a2a144ac-b08d-4295-88df-443904558192 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1565 microversion: 2.1 time: 0.267086 Jul 28 01:16:45.109586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 204/430] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:44 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1565 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:45.146453 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2a45332-dcf0-4b2d-bf0d-8568263bd780 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:45.147098 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2a45332-dcf0-4b2d-bf0d-8568263bd780 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:45.159394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2a45332-dcf0-4b2d-bf0d-8568263bd780 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:45.159970 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2a45332-dcf0-4b2d-bf0d-8568263bd780 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:45.160873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2a45332-dcf0-4b2d-bf0d-8568263bd780 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:45.162173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2a45332-dcf0-4b2d-bf0d-8568263bd780 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:45.271534 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2a45332-dcf0-4b2d-bf0d-8568263bd780 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129862 Jul 28 01:16:45.272525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 227/431] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:16:45 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:45.717403 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:45.719234 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:45.728428 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:45.729040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:45.731057 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:45.731863 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:45.870921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:45.871668 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:45.879661 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:45.880642 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:45.881753 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:45.882296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:45.884507 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:45.892700 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-676aad3d-fa2e-48ad-8ab4-5f1d784eab0b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.179499 Jul 28 01:16:45.894881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 205/432] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:45 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:46.022042 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:46.041895 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:46.043588 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:46.045105 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-78f0b418-7ecf-4e6f-b561-d441c0ad7037 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1810 microversion: 2.20 time: 0.182260 Jul 28 01:16:46.045806 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 228/433] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:45 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:46.069492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:46.070259 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:46.077533 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:46.078127 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:46.079060 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:46.079602 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:46.263803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:46.275518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-eac78cd2-ec1f-46a8-8565-29a782b7dd3d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1452 microversion: 2.1 time: 0.210060 Jul 28 01:16:46.276373 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 206/434] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:46 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:46.309996 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:46.311056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:46.317879 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:46.318334 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:46.319215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:46.319827 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:46.396286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-c4eac983-0606-4c14-b2ff-cb79a4623cf8 req-8d4aa08b-a8d7-4b9c-aea4-0b0d1874882f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52389b09-fdf8-4c6d-8e9d-474a6f793cf4", "tag": "67c0b2f9-537a-48fb-8cc7-ee1426299bf2"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:46.408135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-c4eac983-0606-4c14-b2ff-cb79a4623cf8 req-8d4aa08b-a8d7-4b9c-aea4-0b0d1874882f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:46.408874 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-c4eac983-0606-4c14-b2ff-cb79a4623cf8 req-8d4aa08b-a8d7-4b9c-aea4-0b0d1874882f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:46.423723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-c4eac983-0606-4c14-b2ff-cb79a4623cf8 req-8d4aa08b-a8d7-4b9c-aea4-0b0d1874882f service nova] Creating event network-changed:67c0b2f9-537a-48fb-8cc7-ee1426299bf2 for instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 on hv-cinder-81558 Jul 28 01:16:46.437786 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-c4eac983-0606-4c14-b2ff-cb79a4623cf8 req-8d4aa08b-a8d7-4b9c-aea4-0b0d1874882f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047179 Jul 28 01:16:46.438994 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 207/435] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:16:46.548192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:46.567145 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ffed350c-9b34-46d9-8318-eae566479303 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1452 microversion: 2.1 time: 0.261201 Jul 28 01:16:46.567751 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 229/436] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:46 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1452 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:46.917358 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:46.918139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:46.929493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:46.939110 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:46.940362 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:46.940979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:47.074922 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:47.075538 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:47.088409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:47.091258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:47.093617 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:47.094462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:47.311387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:47.313895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:47.322657 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7a20770a-32ad-4924-9614-409afab753fd tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.411028 Jul 28 01:16:47.338018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 208/437] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:46 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:47.493847 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:47.505099 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:47.507081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:47.507983 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af1f61ee-8ccc-4eba-8af5-d9d06c02ef9b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1752 microversion: 2.20 time: 0.438118 Jul 28 01:16:47.508751 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 230/438] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:47 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1752 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:16:48.347727 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:48.349674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:48.367364 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:48.368085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:48.369060 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:48.369644 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:48.536156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:48.536990 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:48.543492 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:48.543945 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:48.545042 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:48.545498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:48.761893 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:48.787494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ca06f9d8-c22e-4e7f-8b2e-5a6e7a9ee617 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.446510 Jul 28 01:16:48.788987 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 209/439] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:48 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:48.986454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-50395794-9b99-45e4-871d-c43e9876f224 req-7cdac7ec-a0cf-4734-bbb3-f2495fd30cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c015e542-38ce-4335-bfa4-f9c77444f42f", "name": "network-vif-plugged", "status": "completed", "tag": "6f17787d-ed77-4892-b415-19e790741366"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:49.002241 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-50395794-9b99-45e4-871d-c43e9876f224 req-7cdac7ec-a0cf-4734-bbb3-f2495fd30cbb service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:49.002685 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-50395794-9b99-45e4-871d-c43e9876f224 req-7cdac7ec-a0cf-4734-bbb3-f2495fd30cbb service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:49.021416 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-50395794-9b99-45e4-871d-c43e9876f224 req-7cdac7ec-a0cf-4734-bbb3-f2495fd30cbb service nova] Creating event network-vif-plugged:6f17787d-ed77-4892-b415-19e790741366 for instance c015e542-38ce-4335-bfa4-f9c77444f42f on hv-cinder-81558 Jul 28 01:16:49.029911 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-50395794-9b99-45e4-871d-c43e9876f224 req-7cdac7ec-a0cf-4734-bbb3-f2495fd30cbb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047741 Jul 28 01:16:49.029911 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 210/440] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:49.163803 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:49.182501 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:49.184499 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:49.185808 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-787510e4-2aee-41b2-8d86-1c683509b6e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.655038 Jul 28 01:16:49.187684 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 231/441] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:48 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:49.815498 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:49.817326 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:49.821749 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:49.837813 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:49.838670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:49.840337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:49.840975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:50.118738 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:50.128045 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0190993a-5778-4b59-9ffa-a84d90e0cbec tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.318557 Jul 28 01:16:50.128937 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 211/442] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:49 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:50.211520 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:50.212262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:50.225200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:50.231395 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:50.232806 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:50.233896 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:50.279259 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-74549539-5806-43eb-832c-4970a50b72c1 req-3f556235-1388-4314-a37c-221def539644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aad030-b12c-409b-b5da-ba6eb7779f32", "tag": "1e3d4ead-cc70-43f5-a886-471d0c3f9868"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:16:50.302445 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-74549539-5806-43eb-832c-4970a50b72c1 req-3f556235-1388-4314-a37c-221def539644 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:50.302922 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-74549539-5806-43eb-832c-4970a50b72c1 req-3f556235-1388-4314-a37c-221def539644 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:50.327085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-74549539-5806-43eb-832c-4970a50b72c1 req-3f556235-1388-4314-a37c-221def539644 service nova] Creating event network-changed:1e3d4ead-cc70-43f5-a886-471d0c3f9868 for instance 49aad030-b12c-409b-b5da-ba6eb7779f32 on hv-cinder-81558 Jul 28 01:16:50.334679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-74549539-5806-43eb-832c-4970a50b72c1 req-3f556235-1388-4314-a37c-221def539644 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059843 Jul 28 01:16:50.335508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 212/443] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:16:50.430705 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:50.444625 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:50.452800 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:50.454305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3faa44b2-84ac-48e2-a088-ce462d843e53 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.246983 Jul 28 01:16:50.455048 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 232/444] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:50 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:51.152092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:51.153494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:51.160499 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:51.161270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:51.162283 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:51.162931 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:51.376553 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:51.386283 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d15e1565-6b74-4737-a5c5-cba3e7d6750f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.238911 Jul 28 01:16:51.387395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 213/445] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:51 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:51.503231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:51.504181 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:51.520768 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:51.521540 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:51.522666 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:51.527521 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:51.719179 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:51.729671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:51.731942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:51.733377 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-34295086-8e89-4022-a0d3-b62bbb221410 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.252784 Jul 28 01:16:51.749056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 233/446] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:51 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:52.411562 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:52.412918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:52.426259 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:52.427520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:52.431040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:52.431739 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:52.638333 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:52.647549 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-26bd8410-0ece-4ed1-bc6d-9f364bfdcdab tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.240267 Jul 28 01:16:52.648645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 214/447] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:52 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:52.758404 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:52.759091 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:52.766210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:52.766653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:52.767468 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:52.767892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:52.952543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:52.973525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:52.975528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:52.976994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-21a0376a-03ff-420b-81d9-01c3187f3eb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.224047 Jul 28 01:16:52.978143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 234/448] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:52 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:53.679639 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:53.680316 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:53.687762 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:53.688205 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:53.688969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:53.689394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:53.855929 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:53.863898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-30a7afe6-64a9-496f-99c7-def4a6d30673 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.191120 Jul 28 01:16:53.864544 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 215/449] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:53 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:54.003012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:54.003641 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:54.006024 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:54.011504 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:54.011945 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:54.012730 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:54.013153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:54.167975 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:54.177562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:54.179077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:54.180239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ec16cb46-38a4-4b9b-be6d-4258384b5ae8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.182296 Jul 28 01:16:54.180777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 235/450] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:53 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:54.886211 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:54.887615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:54.895121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:54.895977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:54.896996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:54.897642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:55.048491 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:55.057922 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-405b1c97-e818-46f1-aff0-77b8d1f5e7d9 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.175067 Jul 28 01:16:55.057922 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 216/451] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:54 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:55.205197 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:55.205829 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:55.212337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:55.212781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:55.215067 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:55.215767 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:55.386360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:55.395815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:55.397496 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:55.398851 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-529b3712-02c1-4374-8de9-b9ed0f46a4ce tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.198902 Jul 28 01:16:55.399480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 236/452] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:55 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:56.080683 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:56.081420 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:56.087923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:56.088319 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:56.089078 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:56.089490 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:56.266199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:56.275498 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-062a222b-9bdd-4dfd-88da-2a0ebd72251a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.198860 Jul 28 01:16:56.276169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 217/453] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:56 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:56.424689 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:56.425409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:56.432850 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:56.433299 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:56.434135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:56.434581 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:56.614704 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:56.625952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:56.628099 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:56.629615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a3427be0-629f-464c-94a2-da7035dbfa6d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.209281 Jul 28 01:16:56.630979 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 237/454] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:56 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:57.296584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:57.297206 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:57.304094 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:57.304545 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:57.305416 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:57.305875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:57.470756 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:57.485696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0f3a70ed-e2e4-4572-947a-87b86b312975 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.192930 Jul 28 01:16:57.486313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 218/455] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:57 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:57.653283 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:57.653903 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:57.661289 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:57.661852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:57.662818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:57.663373 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:57.668141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:16:57.825499 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:57.839187 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:57.842073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:57.843716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-86136378-309f-4c8f-b27a-bdd09e73db64 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.194347 Jul 28 01:16:57.844861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 238/456] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:57 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:58.508827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:58.509519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:58.520784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:58.521615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:58.523180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:58.523626 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:58.676986 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:58.684910 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-89993996-2098-4d3e-b246-e30e54ca9f1c tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.180374 Jul 28 01:16:58.685741 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 219/457] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:58 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:16:58.872596 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:58.873907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:58.881710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:58.882154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:58.883209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:58.883643 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:59.038019 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:59.047320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:59.048822 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:59.049993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cf86c4aa-950d-44d9-8a83-9a533edd1312 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.181608 Jul 28 01:16:59.050553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 239/458] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:16:58 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:16:59.708438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:16:59.709155 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:16:59.717419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:59.717897 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:59.718729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:16:59.719186 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:16:59.869420 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:16:59.878010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3d7537b4-1331-4cbc-9d87-9ae39ab6bcaf tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.173369 Jul 28 01:16:59.878585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 220/459] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:16:59 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:00.073967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:00.074706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:00.082747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:00.084165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:00.085260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:00.086000 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:00.241854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:00.251413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:00.252973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:00.254210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ab0b5a6d-0483-468c-80ec-effec3fb7837 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.184430 Jul 28 01:17:00.255544 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 240/460] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:00 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:00.901222 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:00.901845 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:00.909395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:00.909861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:00.910645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:00.911119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:01.053256 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:01.060978 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7c6c9afb-50d5-4644-9c91-aee5b3e924e0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1358 microversion: 2.1 time: 0.163850 Jul 28 01:17:01.061558 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 221/461] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:00 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:17:01.281922 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:01.282653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:01.290438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:01.290931 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:01.291722 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:01.292169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:01.464978 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:01.473854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:01.475361 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:01.476557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c9c3ea1-3209-4ed3-a4f2-b6d12cb11023 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.200171 Jul 28 01:17:01.477115 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 241/462] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:01 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:02.086847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:02.088873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:02.105897 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.106441 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.107262 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.107691 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.282802 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:02.290972 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6828ae71-a71f-4024-9edb-52438048f1f0 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1546 microversion: 2.1 time: 0.209435 Jul 28 01:17:02.291705 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 222/463] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:02 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1546 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:02.313774 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:02.314385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:02.321379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.321918 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.322740 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.323230 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.474651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:02.484892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca28d849-44d9-4038-8288-316b14873797 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1546 microversion: 2.1 time: 0.174892 Jul 28 01:17:02.485713 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 242/464] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:02 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:02.501076 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:02.501740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:02.509155 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.509605 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.509838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:02.510386 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.510913 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.514956 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:02.515668 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Searching by: {'deleted': False, 'project_id': '9889594f4bf84c4591714b505f1861fe'} {{(pid=117958) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 01:17:02.523469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.523940 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.524741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.525173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.626790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.multi_cell_list [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117958) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 01:17:02.659903 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:02.668833 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:02.670328 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:02.671528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1c17160e-3a7e-4d91-b91f-60493f22f561 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.175571 Jul 28 01:17:02.672105 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 223/465] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:02 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:02.744837 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8929b8c-ebf1-472d-9935-a71ce54068aa tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.238766 Jul 28 01:17:02.745555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 243/466] 10.222.0.17 () {58 vars in 1125 bytes} [Thu Jul 28 01:17:02 2022] GET /compute/v2.1/servers => generated 343 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:17:02.760347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:02.760949 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:02.767705 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.768170 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.769042 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:02.769468 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:02.924860 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:02.933450 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1896aefe-c950-4086-8c73-0db8937bb1f2 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1546 microversion: 2.1 time: 0.177076 Jul 28 01:17:02.934042 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 224/467] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:02 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:03.696066 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:03.696747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:03.703207 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:03.703672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:03.704447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:03.704847 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:03.854935 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:03.866801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:03.868462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:03.869766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4755edef-c7f3-4eaa-895f-2ff123340e2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.177703 Jul 28 01:17:03.870385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 244/468] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:03 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:04.533818 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e7c932ea-13f7-48ec-a7ed-4e61b69873fb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efe4348f-b53a-4592-aae2-b519ce9ce366"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:04.536454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e7c932ea-13f7-48ec-a7ed-4e61b69873fb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:04.543869 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7c932ea-13f7-48ec-a7ed-4e61b69873fb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:04.544321 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7c932ea-13f7-48ec-a7ed-4e61b69873fb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:04.545103 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7c932ea-13f7-48ec-a7ed-4e61b69873fb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:04.545540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7c932ea-13f7-48ec-a7ed-4e61b69873fb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:04.790011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:04.811992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e7c932ea-13f7-48ec-a7ed-4e61b69873fb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282175 Jul 28 01:17:04.812837 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 225/469] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:17:04 2022] POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:17:04.893718 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:04.894264 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:04.900545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:04.901095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:04.901948 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:04.902459 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:05.043804 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:05.052781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:05.054256 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:05.055481 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1944faf8-506a-4879-b9ae-c46c6069420f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.165928 Jul 28 01:17:05.056027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 245/470] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:04 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:06.080097 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:06.080800 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:06.088419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:06.088867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:06.089657 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:06.090095 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:06.233139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:06.243761 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:06.245277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:06.246431 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9f93810d-1332-4b68-861c-c08c52760e93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.171603 Jul 28 01:17:06.247022 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 226/471] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:06 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:07.271440 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:07.271982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:07.278279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:07.278793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:07.279603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:07.280035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:07.413180 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:07.421656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:07.423194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:07.424352 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-926cebdc-2fda-4092-b370-fa80d04e5a40 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.157270 Jul 28 01:17:07.424960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 246/472] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:07 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:08.449314 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:08.449979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:08.457412 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:08.457855 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:08.458636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:08.459090 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:08.595567 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:08.608135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:08.610538 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:08.612391 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f3a6e55c-32cf-4a4f-8be7-98b0ddf79b7a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.167775 Jul 28 01:17:08.612951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 227/473] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:08 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:09.636804 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:09.637415 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:09.645013 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:09.645723 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:09.646515 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:09.646986 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:09.788470 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:09.799060 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:09.801032 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:09.802542 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e911c343-9c49-4cc7-ab75-b43b59a4d604 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.170432 Jul 28 01:17:09.803332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 247/474] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:09 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:10.827024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:10.827829 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:10.835357 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:10.835884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:10.836778 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:10.837303 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:11.002889 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:11.012582 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:11.014396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:11.015627 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dc9c9fe5-6086-404d-8fd8-52b20fa38930 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.192661 Jul 28 01:17:11.016183 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 228/475] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:10 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:11.374214 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:11.374877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:11.382086 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:11.382539 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:11.383357 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:11.383795 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:11.530607 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lazy-loading 'services' on Instance uuid 0b3c75a9-eb23-4978-bb95-53fe1e079f36 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:17:11.653270 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d793d548-d5df-40e3-8e95-ec18e10aeb3a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-volume_attachments/b921fc59-6afd-45c6-a69e-0a559939c54b" status: 202 len: 0 microversion: 2.1 time: 0.282940 Jul 28 01:17:11.653881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 248/476] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:17:11 2022] DELETE /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-volume_attachments/b921fc59-6afd-45c6-a69e-0a559939c54b => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:17:12.058190 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:12.058876 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:12.066336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:12.066794 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:12.067662 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:12.068082 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:12.219748 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:12.233761 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:12.235303 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:12.236484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2a0111a4-ce02-40eb-883d-f2a328d6b84a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.182362 Jul 28 01:17:12.237055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 229/477] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:12 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:13.163762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:13.169646 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-20e7bcc3-9d84-40b2-8d5c-0dcbcf7d0373 req-97d2927d-ffbe-4051-aac0-0ce544c9577c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300e3c0c-fb14-4c05-b53a-fe8f0589ac1b", "name": "network-vif-plugged", "status": "completed", "tag": "a76b2846-749f-47c3-81f3-a7c5328f00ad"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:13.181251 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-20e7bcc3-9d84-40b2-8d5c-0dcbcf7d0373 req-97d2927d-ffbe-4051-aac0-0ce544c9577c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:13.181851 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-20e7bcc3-9d84-40b2-8d5c-0dcbcf7d0373 req-97d2927d-ffbe-4051-aac0-0ce544c9577c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:13.194658 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-20e7bcc3-9d84-40b2-8d5c-0dcbcf7d0373 req-97d2927d-ffbe-4051-aac0-0ce544c9577c service nova] Creating event network-vif-plugged:a76b2846-749f-47c3-81f3-a7c5328f00ad for instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b on hv-cinder-81558 Jul 28 01:17:13.199760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-20e7bcc3-9d84-40b2-8d5c-0dcbcf7d0373 req-97d2927d-ffbe-4051-aac0-0ce544c9577c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Jul 28 01:17:13.200380 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 249/478] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:17:13.262183 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:13.262780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:13.271398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:13.272010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:13.272971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:13.273415 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:13.432608 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:13.442072 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:13.443994 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:13.445240 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d18473cf-1d41-42eb-ba83-9d1ce1e1d3ae tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.186995 Jul 28 01:17:13.445832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 230/479] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:13 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:14.469323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:14.470010 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:14.476528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:14.476949 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:14.477680 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:14.478589 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:14.614224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:14.623322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:14.624810 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:14.625991 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e8fd9055-64e9-41e5-87fa-cf89e4150db8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.161083 Jul 28 01:17:14.626562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 250/480] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:14 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:15.652934 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:15.653516 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:15.663335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:15.663784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:15.664561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:15.664969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:15.801079 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:15.810148 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:15.811692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:15.812868 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-67846de3-14c8-46ec-9c18-ebd3f55e5672 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.166328 Jul 28 01:17:15.813426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 231/481] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:15 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:16.836802 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:16.837395 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:16.843923 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:16.844364 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:16.845132 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:16.845581 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:16.999830 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:17.009172 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:17.010656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:17.011966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-58cb3b61-1c23-4b1d-a9be-be1d3cb09256 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.179453 Jul 28 01:17:17.012400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 251/482] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:16 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:17.404905 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:17:17.405350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Thu Jul 28 01:17:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:17:18.034914 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:18.035516 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:18.042583 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:18.043076 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:18.043858 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:18.044281 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:18.179982 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:18.188916 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:18.190421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:18.191625 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4c40515f-bf80-4b7c-b181-9b1c28c83edc tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.160750 Jul 28 01:17:18.192182 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 232/483] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:18 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:19.215208 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:19.215846 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:19.222287 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:19.222744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:19.223541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:19.224007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:19.370420 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:19.382701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:19.384872 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:19.386033 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f8671ebd-8cbc-4c9b-bc36-6f5fad192e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.174999 Jul 28 01:17:19.386644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 252/484] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:19 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:20.411943 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:20.412504 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:20.414895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=44 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:20.421484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:20.421941 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:20.422712 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:20.423181 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:20.580761 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:20.589828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:20.591777 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:20.593062 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1c85a1be-c618-45db-b499-72a0d22453c4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.186458 Jul 28 01:17:20.593644 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 233/485] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:20 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:21.617156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:21.617805 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:21.625575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:21.625998 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:21.626798 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:21.627254 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:21.783764 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:21.793478 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:21.794999 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:21.796175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-62f59b73-a356-4312-86ae-7425e102f929 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.183242 Jul 28 01:17:21.796734 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 253/486] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:21 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:22.822199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:22.823375 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:22.829867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:22.830311 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:22.831108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:22.831541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:22.994267 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:23.012641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:23.014119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:23.015315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1bf5a5fd-8148-4c70-8b3b-a63e34bf27f3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.198929 Jul 28 01:17:23.015867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 234/487] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:22 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:24.042985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:24.044214 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:24.047372 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=38 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:24.053143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:24.053592 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:24.054400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:24.054859 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:24.074926 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:24.197790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:24.206413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:24.207936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:24.209087 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-19410d75-6a13-4476-9213-4187ec8ca8a3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.173009 Jul 28 01:17:24.209646 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 254/488] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:24 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:17:25.233047 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:25.233723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:25.242577 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:25.243018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:25.243992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:25.244588 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:25.388028 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:25.396849 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:25.398370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:25.399575 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f63e3b62-5660-4b80-a384-699f095ee8da tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.170685 Jul 28 01:17:25.400108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 235/489] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:25 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:26.425994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:26.426599 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:26.433307 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:26.433761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:26.434542 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:26.435045 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:26.580544 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:26.590102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:26.591673 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:26.593615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ffc2eade-ae1d-4508-814d-a5c210362f07 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.172181 Jul 28 01:17:26.593615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 255/490] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:26 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:27.616330 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:27.616944 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:27.624345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:27.624787 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:27.625559 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:27.625992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:27.763496 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:27.775766 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:27.777265 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:27.778430 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ee7bfd9a-dc04-4d4e-a7ca-11e70a0e6129 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.166088 Jul 28 01:17:27.779080 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 236/491] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:27 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:28.802703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:28.803556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:28.812421 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:28.812947 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:28.814601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:28.815150 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:28.956078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:28.964987 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:28.966462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:28.967651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-95275d88-308c-4bec-a460-5c45e739f9c6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.169670 Jul 28 01:17:28.968205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 256/492] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:28 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:29.998600 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:29.999358 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:30.006729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:30.007180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:30.007947 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:30.008399 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:30.151471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:30.159992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:30.161499 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:30.162647 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6ebc025b-108b-442d-a0bd-fb9fc3a4101b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.169315 Jul 28 01:17:30.163241 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 237/493] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:29 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:30.555297 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:30.555861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:30.562003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:30.562450 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:30.563229 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:30.563656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:30.700049 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:30.708404 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-df3ac766-8eee-484f-b344-7e7e14a47cce tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1592 microversion: 2.1 time: 0.156966 Jul 28 01:17:30.708977 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 257/494] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:30 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:17:31.186095 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:31.186737 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:31.193571 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:31.194027 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:31.194827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:31.195323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:31.346909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:31.357956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:31.359484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:31.360662 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-317defba-9d27-4ef0-ac07-4bc5b980cfba tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.178693 Jul 28 01:17:31.361227 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 238/495] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:31 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:32.392178 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:32.393262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:32.402641 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:32.403156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:32.403942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:32.404353 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:32.531051 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-35e4a5b5-b51d-4b90-a3e6-89b1b2f19cf3 req-b6ff953f-2e9a-4d35-8dac-5182a07e5853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c015e542-38ce-4335-bfa4-f9c77444f42f", "tag": "6f17787d-ed77-4892-b415-19e790741366"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:32.546323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-35e4a5b5-b51d-4b90-a3e6-89b1b2f19cf3 req-b6ff953f-2e9a-4d35-8dac-5182a07e5853 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:32.548012 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-35e4a5b5-b51d-4b90-a3e6-89b1b2f19cf3 req-b6ff953f-2e9a-4d35-8dac-5182a07e5853 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:32.570532 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:32.571955 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-35e4a5b5-b51d-4b90-a3e6-89b1b2f19cf3 req-b6ff953f-2e9a-4d35-8dac-5182a07e5853 service nova] Creating event network-changed:6f17787d-ed77-4892-b415-19e790741366 for instance c015e542-38ce-4335-bfa4-f9c77444f42f on hv-cinder-81558 Jul 28 01:17:32.583384 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-35e4a5b5-b51d-4b90-a3e6-89b1b2f19cf3 req-b6ff953f-2e9a-4d35-8dac-5182a07e5853 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056331 Jul 28 01:17:32.586878 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:32.587033 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 239/496] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:17:32.588993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:32.590875 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4402b307-75fa-4070-827d-f2bf9cf0597b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.206316 Jul 28 01:17:32.591781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 258/497] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:32 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:32.624056 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f6c47a6b-9512-4968-a109-981a004e780a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd91aa1-891a-48d3-8215-767dcea2ac74"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:32.626775 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f6c47a6b-9512-4968-a109-981a004e780a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:32.634369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f6c47a6b-9512-4968-a109-981a004e780a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:32.635054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f6c47a6b-9512-4968-a109-981a004e780a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:32.636223 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f6c47a6b-9512-4968-a109-981a004e780a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:32.636817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f6c47a6b-9512-4968-a109-981a004e780a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:33.603057 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-694084589"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:33.603616 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:33.609899 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:33.610351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:33.611190 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:33.611796 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:33.744426 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.network.security_group_api [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Adding security group dc06e2eb-a2eb-47c1-b95a-e012ec978612 to port 6f17787d-ed77-4892-b415-19e790741366 Jul 28 01:17:34.157718 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2a7b94ba-d42e-4b98-a402-0576f74575a3 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/action" status: 202 len: 0 microversion: 2.1 time: 0.558784 Jul 28 01:17:34.159655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 259/498] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:17:33 2022] POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:17:34.168083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:34.168957 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:34.176512 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:34.177230 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:34.178215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:34.178790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:34.340043 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:34.349721 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:34.352203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:34.354346 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b616fed8-0f57-470e-9367-cb57987ccd93 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.189965 Jul 28 01:17:34.355132 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 260/499] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:34 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:34.371013 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-7d647b64-4805-45e1-a1bd-91c88af2ba1a req-abc6feb8-2bbf-43de-9cd2-c1bb15be49f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c015e542-38ce-4335-bfa4-f9c77444f42f", "tag": "6f17787d-ed77-4892-b415-19e790741366"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:34.387057 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-7d647b64-4805-45e1-a1bd-91c88af2ba1a req-abc6feb8-2bbf-43de-9cd2-c1bb15be49f3 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:34.387511 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-7d647b64-4805-45e1-a1bd-91c88af2ba1a req-abc6feb8-2bbf-43de-9cd2-c1bb15be49f3 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:34.399021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-7d647b64-4805-45e1-a1bd-91c88af2ba1a req-abc6feb8-2bbf-43de-9cd2-c1bb15be49f3 service nova] Creating event network-changed:6f17787d-ed77-4892-b415-19e790741366 for instance c015e542-38ce-4335-bfa4-f9c77444f42f on hv-cinder-81558 Jul 28 01:17:34.404522 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-7d647b64-4805-45e1-a1bd-91c88af2ba1a req-abc6feb8-2bbf-43de-9cd2-c1bb15be49f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047601 Jul 28 01:17:34.405164 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 261/500] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:17:34.410042 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:34.411171 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:34.418323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:34.418686 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:34.419506 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:34.419937 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:34.607968 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:34.616789 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bfafa468-94cb-4c1a-8af6-6adeb2bcc16d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1638 microversion: 2.1 time: 0.210634 Jul 28 01:17:34.617761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 262/501] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:34 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1638 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:35.385284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:35.386329 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:35.395553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:35.396234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:35.397372 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:35.398084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:35.542671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:35.551864 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:35.553288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:35.554469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ddd47603-60dc-4013-b17d-f1a3d0d468ee tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.176451 Jul 28 01:17:35.555196 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 263/502] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:35 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:36.580774 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:36.581711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:36.588758 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:36.589360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:36.590431 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:36.591143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:36.842700 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:36.854603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:36.856565 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:36.858249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-40c9150d-939b-467b-a32a-548f0852bbf9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.281452 Jul 28 01:17:36.859075 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 264/503] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:36 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:17:37.882555 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:37.883713 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:37.889992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:37.890599 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:37.891508 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:37.892320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:38.092559 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:38.103169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:38.104934 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:38.106366 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b23909ae-c226-49a9-87ac-bed274d28fdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.228570 Jul 28 01:17:38.107422 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 265/504] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:37 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:17:39.131781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:39.132373 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:39.139808 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:39.140710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:39.141511 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:39.142119 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:39.317520 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:39.327393 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:39.329112 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:39.330459 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b20e51ff-5595-42e3-9605-08da0183e765 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.203245 Jul 28 01:17:39.331349 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 266/505] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:39 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:40.099669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:40.283315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f6c47a6b-9512-4968-a109-981a004e780a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.663953 Jul 28 01:17:40.283780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 240/506] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:17:32 2022] POST /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments => generated 194 bytes in 7666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:17:40.368250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:40.369639 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:40.390553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:40.391110 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:40.392710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:40.394589 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:40.622817 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:40.644087 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:40.646012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:40.647651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-771cc186-6b2b-4acd-96a0-9ecf9cb4bbb0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.295958 Jul 28 01:17:40.648335 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 267/507] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:40 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:41.611156 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7b71d66a-ef9f-4b69-a3dc-3a64f65e147f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:41.619386 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7b71d66a-ef9f-4b69-a3dc-3a64f65e147f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:41.620020 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7b71d66a-ef9f-4b69-a3dc-3a64f65e147f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:41.647369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7b71d66a-ef9f-4b69-a3dc-3a64f65e147f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Going to try to stop instance {{(pid=117960) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 01:17:41.673043 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:41.674560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:41.684241 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:41.687568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:41.688529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:41.689513 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:41.743283 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7b71d66a-ef9f-4b69-a3dc-3a64f65e147f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action" status: 202 len: 0 microversion: 2.1 time: 0.134899 Jul 28 01:17:41.745320 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 241/508] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:17:41 2022] POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:17:41.759051 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:41.760299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:41.772364 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:41.772881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:41.773927 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:41.774569 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:42.016626 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:42.025690 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:42.027333 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:42.028511 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a4845f8a-c86c-445b-a11e-b4ed7ec83572 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.359554 Jul 28 01:17:42.029095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 268/509] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:41 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:42.066978 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:42.079940 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ccd45f1f-2f6c-4d2a-afee-84037b018b87 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.329997 Jul 28 01:17:42.080650 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 242/510] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:41 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:43.055933 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:43.056568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:43.071477 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:43.074339 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:43.075283 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:43.077581 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:43.102566 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:43.104436 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:43.123149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:43.124756 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:43.127963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:43.129562 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:43.472728 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:43.488184 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f7e50c61-6e51-4eac-a10a-7913d09d8769 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.390236 Jul 28 01:17:43.495277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 243/511] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:43 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:43.527562 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:43.537385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:43.544208 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:43.545485 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9491f41b-aca1-4f9e-ba41-d3eea349ae83 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1808 microversion: 2.20 time: 0.496590 Jul 28 01:17:43.546332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 269/512] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:43 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1808 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:17:44.519049 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:44.519647 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:44.528804 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:44.529619 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:44.531611 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:44.532209 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:44.571537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:44.572856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:44.583930 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:44.584374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:44.585154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:44.585579 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:44.923304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:44.932905 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fbff3d8a-e112-43d0-a87e-580f3709aed4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.418302 Jul 28 01:17:44.933526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 244/513] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:44 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:44.958315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:44.969510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:44.971063 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:44.972278 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f0ec7d53-695c-4689-8b73-4a8019dd6c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1795 microversion: 2.20 time: 0.405118 Jul 28 01:17:44.972841 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 270/514] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:17:44 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1795 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:17:45.954094 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:45.954663 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:45.961959 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:45.962492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:45.963485 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:45.963987 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:46.120866 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:46.130780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-43a4a553-0452-40e7-844b-e850321ef5ec tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.179821 Jul 28 01:17:46.131707 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 245/515] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:45 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:46.861889 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a9a786db-f5ce-443e-8c8e-d53cac42c6f4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Action: 'create', calling method: .version_select at 0x7ff71c4e1af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1209159014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX/er9o/Oasul/WLmmzfjLXTDypCFYfCzQt/5BbSVf6WiuWmt7CJC1eOkrX3OU3jM2BLEF/71YY+EJ011z2d849TF5vNTTcM49pK1QzMu/fLiG9q7s1ssUsLt6kRKWrkg=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:46.877530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-a9a786db-f5ce-443e-8c8e-d53cac42c6f4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Getting quotas for project b1331035c6654c0d9c8ba49f5a724f8c. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:17:46.881952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-a9a786db-f5ce-443e-8c8e-d53cac42c6f4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Getting quotas for user eee7bd9e4fa14b159277977043f4813c and project b1331035c6654c0d9c8ba49f5a724f8c. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:17:46.911057 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a9a786db-f5ce-443e-8c8e-d53cac42c6f4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.247412 Jul 28 01:17:46.911805 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 271/516] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:17:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:17:47.158948 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:47.160999 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:47.175957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:47.176441 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:47.177529 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:47.178018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:47.550546 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:47.560202 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6f4c9f15-0ec6-4b25-882d-3fdec6adbce0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.411841 Jul 28 01:17:47.560833 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 246/517] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:47 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:48.068320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:48.070581 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:48.077463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.077913 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.078746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.079320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.110533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lazy-loading 'flavor' on Instance uuid 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:17:48.129223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:48.253629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-17d28a69-7b3a-4de6-9234-33ce53e49e32 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/action" status: 200 len: 32 microversion: 2.1 time: 0.189371 Jul 28 01:17:48.254263 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 272/518] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:17:48 2022] POST /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:17:48.266272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:48.266917 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:48.277424 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.278878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.281243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.281943 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.434170 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:48.443187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e7241f66-2c07-409e-87df-6577da493dbe tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.181499 Jul 28 01:17:48.443705 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 247/519] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:48 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:48.517699 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b484b6cc-5e15-4522-9aa5-b7694e0e25a4 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:48.520522 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b484b6cc-5e15-4522-9aa5-b7694e0e25a4 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:48.527737 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b484b6cc-5e15-4522-9aa5-b7694e0e25a4 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.528260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b484b6cc-5e15-4522-9aa5-b7694e0e25a4 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.529122 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b484b6cc-5e15-4522-9aa5-b7694e0e25a4 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.529788 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b484b6cc-5e15-4522-9aa5-b7694e0e25a4 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.585645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:48.586620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:48.594526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.604360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.605355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.606186 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.647003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b484b6cc-5e15-4522-9aa5-b7694e0e25a4 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/action" status: 202 len: 0 microversion: 2.1 time: 0.133994 Jul 28 01:17:48.648487 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 273/520] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:17:48 2022] POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:17:48.674731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:48.677739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:48.698341 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.699235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:48.706497 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:48.707445 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:49.065056 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:49.075879 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dfccc07f-ce11-4bcc-b823-45dfa7fb0110 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.494054 Jul 28 01:17:49.077580 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 248/521] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:48 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:17:49.125988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:49.135446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-816e57ad-9a02-4b04-8189-3a91879fc9cc tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1748 microversion: 2.1 time: 0.473373 Jul 28 01:17:49.136030 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 274/522] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:48 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1748 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:49.463595 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:49.464124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:49.470723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:49.471481 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:49.472519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:49.472960 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:49.693700 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:49.702206 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b7ada724-c277-47ed-aed7-71bd62d29ebb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.242560 Jul 28 01:17:49.702775 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 249/523] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:49 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:50.100204 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:50.100856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:50.107602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:50.108271 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:50.109078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:50.109504 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:50.158703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:50.159410 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:50.165634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:50.166072 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:50.166922 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:50.167584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:50.358884 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:50.368209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-45f859c5-cef4-4ccb-868c-abf27c9086bd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.272011 Jul 28 01:17:50.368818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 275/524] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:50 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:50.494503 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:50.503875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-87b84163-7fe9-4d70-b1d8-9fe1367298fe tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.349282 Jul 28 01:17:50.506460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 250/525] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:50 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:17:50.731518 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:50.732375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:50.739249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:50.739498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:50.740272 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:50.740698 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:50.895216 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:50.904061 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e3682145-cf0f-4455-9a14-4699663c871b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.183649 Jul 28 01:17:50.904965 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 276/526] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:50 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:51.391000 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:51.391604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:51.393614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=36 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:51.399425 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:51.399869 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:51.400635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:51.401121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:51.534211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:51.534821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:51.542194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:51.542653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:51.543468 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:51.543880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:51.544322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:51.552284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e7ff8180-bf6c-4507-9d6c-bab9b72617a8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1678 microversion: 2.1 time: 0.165167 Jul 28 01:17:51.552845 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 251/527] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:51 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:51.691624 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:51.699967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a3f09871-6c49-4ae5-ac1e-89be50cc6018 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.171394 Jul 28 01:17:51.700509 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 277/528] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:51 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:51.928593 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:51.929584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:51.936990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:51.937442 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:51.938215 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:51.938659 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.075511 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:52.083895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-973d82b4-c9ad-44f3-8b75-b37140a804b7 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.161412 Jul 28 01:17:52.084463 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 252/529] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:51 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:52.573731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:52.574370 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:52.581006 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:52.581460 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.582252 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:52.582691 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.721817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:52.722439 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:52.726450 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:52.729371 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:52.729821 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.731112 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:52.731635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.734498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-880fbd22-ce5e-4db1-b689-bac7c99982e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1655 microversion: 2.1 time: 0.164832 Jul 28 01:17:52.735051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 278/530] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:52 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:52.755539 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-edba1718-978a-47cc-bacf-20b6ebd28b23 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:17:52.761936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-edba1718-978a-47cc-bacf-20b6ebd28b23 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:52.762527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-edba1718-978a-47cc-bacf-20b6ebd28b23 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.785281 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-edba1718-978a-47cc-bacf-20b6ebd28b23 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Going to try to start instance {{(pid=117958) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 01:17:52.830028 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-edba1718-978a-47cc-bacf-20b6ebd28b23 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action" status: 202 len: 0 microversion: 2.1 time: 0.078557 Jul 28 01:17:52.833888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 279/531] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:17:52 2022] POST /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:17:52.839999 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:52.840852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:52.847581 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:52.848322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.849647 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:52.850017 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:52.892244 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:52.902102 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fdedd8cb-bc3d-43c6-b29b-d8b911f75c82 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.184168 Jul 28 01:17:52.907092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 253/532] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:52 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:53.083784 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:53.092354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-716a8507-cfb4-419e-8172-f9a7039895cd tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1664 microversion: 2.1 time: 0.256992 Jul 28 01:17:53.099096 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 280/533] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:52 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1664 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:53.105204 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:53.105939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:53.112202 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:53.112740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:53.113561 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:53.114070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:53.330703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:53.339457 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c4c10bdd-9dff-4e99-8a69-10ea9c03f795 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.238129 Jul 28 01:17:53.340139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 254/534] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:53 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:53.924281 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:53.924887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:53.931537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:53.932001 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:53.932853 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:53.933282 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:54.104015 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:54.113412 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1dcaa29b-2108-4181-b162-535ad833d343 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.193061 Jul 28 01:17:54.114148 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 281/535] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:53 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:54.114270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:54.114711 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:54.121635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:54.122171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:54.123087 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:54.123586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:54.139102 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:54.273651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:54.281522 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8c284749-4741-469e-8209-1ea2c199eaf7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1664 microversion: 2.1 time: 0.171636 Jul 28 01:17:54.282099 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 255/536] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:54 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:54.364261 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:54.365030 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:54.367631 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:54.377176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:54.378143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:54.379204 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:54.379632 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:54.523791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:54.532396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-284e16dd-888d-4e17-b1ee-ef883e23321b tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.174232 Jul 28 01:17:54.532974 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 282/537] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:54 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:55.135541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:55.136356 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:55.143453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:55.143904 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:55.144675 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:55.145110 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:55.299846 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:55.303259 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:55.303871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:55.307957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-59a0d218-4a1d-4e67-80b7-7cd21a2983a6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.176333 Jul 28 01:17:55.308573 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 256/538] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:55 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:55.310371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:55.310820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:55.311612 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:55.312142 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:55.450516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:55.461883 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3be2b4ca-f691-4bdd-9790-6c166bb01f4b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1668 microversion: 2.1 time: 0.162194 Jul 28 01:17:55.462631 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 283/539] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:55 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:55.555367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:55.555966 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:55.562747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:55.563224 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:55.563972 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:55.564471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:55.708484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:55.716876 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-229508e1-d2e3-4520-a686-25c8741db465 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.165563 Jul 28 01:17:55.717534 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 257/540] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:55 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:56.331211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:56.331936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:56.340497 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:56.341651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:56.341920 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:56.342376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:56.498429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:56.507028 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7ea60e55-651b-433f-bf48-03ebc25c181d tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.181380 Jul 28 01:17:56.507608 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 284/541] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:56 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:56.738099 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:56.738712 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:56.745807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:56.746272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:56.747083 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:56.747537 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:56.895819 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:56.904243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1c4f13db-69d2-439d-8712-f50306b6e5e5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.170114 Jul 28 01:17:56.904817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 258/542] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:56 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:57.530350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:57.537426 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:57.538051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:57.545173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:57.545623 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:57.546397 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:57.546866 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:57.700193 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:57.703888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:17:57.710072 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8adfb31b-8d52-4e98-b702-046626c9222e tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.181005 Jul 28 01:17:57.710657 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 285/543] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:57 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:57.926336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:57.927075 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:57.934007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:57.934446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:57.935233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:57.935686 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:58.072979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:58.081737 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fac6c1c3-afe1-4e50-bcbd-382159cec862 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.159290 Jul 28 01:17:58.082323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 259/544] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:57 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:58.732260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:58.732886 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:58.740885 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:58.741339 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:58.742117 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:58.742549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:58.898188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:58.906772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-91e383d7-9868-4108-ba51-e4c4020bacc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.178488 Jul 28 01:17:58.907395 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 286/545] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:58 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:59.103706 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:59.104337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:59.111213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:59.111641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:59.112409 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:59.112845 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:59.248269 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:17:59.257430 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-03fa14db-ecdf-435d-aae1-010e2fe80732 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.157731 Jul 28 01:17:59.258038 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 260/546] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:59 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:17:59.929357 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:17:59.930023 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:17:59.936364 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:59.936814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:17:59.937584 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:17:59.938156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:00.097674 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:00.106165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9aa30800-c656-4923-9d7f-2c1fdbc7c661 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.181428 Jul 28 01:18:00.106753 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 287/547] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:17:59 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:00.281421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:00.281992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:00.289163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:00.289616 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:00.290407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:00.292250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:00.440156 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:00.449253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-27cdce7c-d85e-41ee-b71b-ece1e3143871 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.172501 Jul 28 01:18:00.450144 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 261/548] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:00 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:01.127827 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:01.128445 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:01.135078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:01.135529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:01.136292 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:01.136763 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:01.290999 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:01.299190 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d9390bf0-9b62-4608-b135-2aae820bddc6 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.175169 Jul 28 01:18:01.299789 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 288/549] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:01 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:01.471802 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:01.472374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:01.479494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:01.479926 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:01.480703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:01.481138 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:01.622022 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:01.632228 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5a4ac598-bcd7-4eed-9db3-06bf7ae4db89 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.164401 Jul 28 01:18:01.633081 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 262/550] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:01 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:02.321451 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:02.322322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:02.329768 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:02.330194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:02.331008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:02.331437 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:02.497755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:02.513614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d50361a-34ce-407c-9828-27d00baaf83f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.196109 Jul 28 01:18:02.514446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 289/551] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:02 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:02.655093 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:02.655759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:02.662763 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:02.663243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:02.664036 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:02.664470 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:02.811041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:02.820613 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f14778e4-596b-4b87-8cc7-9e6586937fff tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.169958 Jul 28 01:18:02.821452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 263/552] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:02 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:03.536963 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:03.537623 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:03.544417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:03.544870 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:03.545640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:03.546079 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:03.706720 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:03.716369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ac1de813-3f31-458a-820f-013096e3da43 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.183465 Jul 28 01:18:03.716914 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 290/553] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:03 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:03.849277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:03.849888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:03.856704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:03.857155 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:03.857926 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:03.858364 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:04.012877 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:04.021621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ce5d4c24-d69c-4acc-8a02-4d2e8c38678f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.176178 Jul 28 01:18:04.022169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 264/554] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:03 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:04.747433 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:04.748211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:04.757147 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:04.757712 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:04.758729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:04.759383 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:04.911761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:04.919964 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3622f024-ffd8-4196-bff4-e8ef79ccdb5a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.177785 Jul 28 01:18:04.920912 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 291/555] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:04 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:05.045292 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:05.046134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:05.056652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:05.057331 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:05.058299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:05.058878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:05.204217 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:05.214680 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b70b224c-2bad-4915-a9fc-81ec8db5f7c8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.175263 Jul 28 01:18:05.218963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 265/556] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:05 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:05.948892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:05.949757 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:05.957184 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:05.957716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:05.958621 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:05.959077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:05.959823 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1089094702", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1209159014", "security_groups": [{"name": "tempest-secgroup-smoke-726010540"}], "networks": [{"uuid": "4973681c-a66b-4d24-b5aa-4a1b9f0d40c4"}], "block_device_mapping_v2": [{"uuid": "843c2287-25b0-46e5-aef0-c8184ff19903", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:06.119890 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] validate_networks() for [('4973681c-a66b-4d24-b5aa-4a1b9f0d40c4', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:18:06.208765 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:06.217219 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b9d92349-508d-4939-b2a7-548b9b60a513 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.272117 Jul 28 01:18:06.218008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 292/557] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:05 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:06.235793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:06.236412 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:06.242595 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:06.243067 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:06.243825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:06.244252 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:06.463605 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:06.472039 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-04fcb3c9-7125-45a9-b27e-0eadc8d66f9f tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.240024 Jul 28 01:18:06.472975 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 293/558] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:06 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:06.591855 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:18:06.592276 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:18:06.592752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:18:06.593200 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:18:06.593609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:18:06.603336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:06.603772 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:06.604581 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:06.605018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:06.622274 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Getting quotas for project b1331035c6654c0d9c8ba49f5a724f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:18:06.626678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Getting quotas for user eee7bd9e4fa14b159277977043f4813c and project b1331035c6654c0d9c8ba49f5a724f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:18:06.687613 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:18:06.689713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='843c2287-25b0-46e5-aef0-c8184ff19903',volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:18:06.832804 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a71e054f-7e74-409d-9547-df2c69d40313 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.876674 Jul 28 01:18:06.833648 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 266/559] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:18:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:18:06.844614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f706e229-4c0e-4210-b3e3-7566b295f8cc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:06.845339 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f706e229-4c0e-4210-b3e3-7566b295f8cc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:06.900859 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f706e229-4c0e-4210-b3e3-7566b295f8cc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:06.907569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f706e229-4c0e-4210-b3e3-7566b295f8cc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1089 microversion: 2.1 time: 0.067027 Jul 28 01:18:06.908141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 294/560] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:06 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:07.239482 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:07.240260 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:07.248744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:07.249187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:07.250135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:07.250979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:07.396590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:07.405235 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c0988e1e-488e-4fb1-ac8d-f75a66091f09 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.170515 Jul 28 01:18:07.405799 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 267/561] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:07 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:07.494119 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:07.494677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:07.501731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:07.502170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:07.502965 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:07.503399 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:07.648653 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:07.659567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-22dd73a1-961f-453a-84e3-6214a735b982 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1736 microversion: 2.1 time: 0.169375 Jul 28 01:18:07.660216 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 295/562] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:07 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:07.928040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:07.928659 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:07.935366 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:07.935818 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:07.936599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:07.937038 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:07.999460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:08.007540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-af53a026-7cd2-49d5-8a47-b94ed7947734 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1187 microversion: 2.1 time: 0.083386 Jul 28 01:18:08.008104 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 268/563] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:07 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:08.429278 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:08.431074 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:08.436438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:08.436889 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:08.437747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:08.438163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:08.672259 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:08.680143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:08.680662 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:08.688146 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:08.688717 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:08.689536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:08.689676 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ef43b308-a62e-4584-8364-fc47fe48a873 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.264355 Jul 28 01:18:08.690130 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 296/564] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:08 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:18:08.690365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:08.914136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:08.922575 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6fa76eb5-52ea-4e06-9182-3b1c64fa27b8 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1716 microversion: 2.1 time: 0.246360 Jul 28 01:18:08.923401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 269/565] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:08 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1716 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:18:09.029560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:09.030387 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:09.037088 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.037595 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.038338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.039200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.045574 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:09.046071 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:09.053297 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.053753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.054554 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.055033 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.194079 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] HTTP exception thrown: Cannot 'detach_volume' instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 while it is in vm_state rescued Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Request method failure captured: Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: DELETE /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments/bbd91aa1-891a-48d3-8215-767dcea2ac74 HTTP/1.1 Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLP45uroqJY4tOsw7MzTomogGWczHPDBPjWIO4CSfNcgqhyAZkGNfMAc1Lcng3yx2yG0MrSBbkOLlmT4zOZMqI_5XzYT1aMh3SmbedkYL5v7LOhTHKjqJ180qmpftqTXj8-ryE0chsIPWl-kLy3n4x47dkOY2VUMTOGAnfMLyF6vJU Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:18:09.195832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af4689d2f0ef4d71a1c465610011f2d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 018eb80709e94d5e8653fb6eeb342c54 Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:18:09.197477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Cannot 'detach_volume' instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 while it is in vm_state rescued Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'server_id': '52389b09-fdf8-4c6d-8e9d-474a6f793cf4', 'id': 'bbd91aa1-891a-48d3-8215-767dcea2ac74'} Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:18:09.198492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 while it is in vm_state rescued Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 while it is in vm_state rescued Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:09.199807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Returning 409 to user: Cannot 'detach_volume' instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 while it is in vm_state rescued {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:18:09.200790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3b3014fc-a7f2-4842-bbc4-e59e75e9df02 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments/bbd91aa1-891a-48d3-8215-767dcea2ac74" status: 409 len: 152 microversion: 2.1 time: 0.155724 Jul 28 01:18:09.200790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 270/566] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:18:09 2022] DELETE /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments/bbd91aa1-891a-48d3-8215-767dcea2ac74 => generated 152 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 01:18:09.206465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-31cf8f1e-af17-4a5c-943c-fc05ac9b3489 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:09.207050 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-31cf8f1e-af17-4a5c-943c-fc05ac9b3489 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:09.214109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-31cf8f1e-af17-4a5c-943c-fc05ac9b3489 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.214558 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-31cf8f1e-af17-4a5c-943c-fc05ac9b3489 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.215367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-31cf8f1e-af17-4a5c-943c-fc05ac9b3489 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.215808 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-31cf8f1e-af17-4a5c-943c-fc05ac9b3489 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.254432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:09.263618 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-336ebf57-734d-4299-acba-518b7f974ef3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1193 microversion: 2.1 time: 0.238652 Jul 28 01:18:09.264173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 297/567] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:09 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1193 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:09.277370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:09.291416 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-31cf8f1e-af17-4a5c-943c-fc05ac9b3489 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "POST /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/action" status: 202 len: 0 microversion: 2.1 time: 0.088638 Jul 28 01:18:09.295191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 271/568] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:18:09 2022] POST /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 01:18:09.301761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:09.302503 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:09.309541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.310064 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.310933 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.311729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.555297 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:09.564100 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2ea34450-346f-455d-8234-550a422bbf73 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1724 microversion: 2.1 time: 0.267544 Jul 28 01:18:09.564686 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 298/569] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:09 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:09.713123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:09.713867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:09.720465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.721347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.722136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:09.722605 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:09.952315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:09.961301 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4408f876-f780-427d-850e-09f5f1ceb43b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.253231 Jul 28 01:18:09.961905 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 272/570] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:09 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:10.284738 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:10.285330 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:10.291374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:10.291823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:10.292590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:10.293627 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:10.321701 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-afd8b354-a39d-4e11-9a71-d2e85bcb00ec req-861b8668-b96a-494e-b92d-975af6a329c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183b3616-c163-4cad-a062-6d0637e9d642", "tag": "79e0f07f-163d-476a-bcb0-0be5f3ea5eff"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:10.335469 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-afd8b354-a39d-4e11-9a71-d2e85bcb00ec req-861b8668-b96a-494e-b92d-975af6a329c7 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:10.335991 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-afd8b354-a39d-4e11-9a71-d2e85bcb00ec req-861b8668-b96a-494e-b92d-975af6a329c7 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:10.350996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-afd8b354-a39d-4e11-9a71-d2e85bcb00ec req-861b8668-b96a-494e-b92d-975af6a329c7 service nova] Creating event network-changed:79e0f07f-163d-476a-bcb0-0be5f3ea5eff for instance 183b3616-c163-4cad-a062-6d0637e9d642 on hv-cinder-81558 Jul 28 01:18:10.356888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-afd8b354-a39d-4e11-9a71-d2e85bcb00ec req-861b8668-b96a-494e-b92d-975af6a329c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038772 Jul 28 01:18:10.358106 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 273/571] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:10.448528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:10.456550 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cb930e13-bcd3-4d4f-8979-c033bfffacbe tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.175647 Jul 28 01:18:10.457172 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 299/572] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:10 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:10.588327 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:10.589028 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:10.596134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:10.596555 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:10.597354 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:10.597787 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:10.734752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:10.743551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-73a5ba99-3c3a-4e4b-ba05-0f496331c051 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1724 microversion: 2.1 time: 0.159516 Jul 28 01:18:10.744167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 274/573] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:10 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:10.983425 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:10.984029 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:10.990711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:10.991169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:10.991929 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:10.992354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:11.149629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:11.157614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e43c8d18-e530-47dd-aa25-a177f868ea10 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.178141 Jul 28 01:18:11.158189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 300/574] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:10 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:11.478055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:11.478180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:11.484678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:11.485131 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:11.485936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:11.486367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:11.633227 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:11.641092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e2ff4802-71f5-4713-be42-5a34d70c3e87 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.167585 Jul 28 01:18:11.641666 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 275/575] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:11 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:11.765758 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:11.766330 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:11.773195 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:11.773651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:11.774418 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:11.774883 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:11.927758 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:11.936146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ea715d03-688d-44f6-bf85-f137111e7b20 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1724 microversion: 2.1 time: 0.174479 Jul 28 01:18:11.936730 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 301/576] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:11 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:12.179558 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:12.180137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:12.187138 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:12.187564 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:12.188337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:12.188760 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:12.352623 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:12.361336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-62e4d49b-8cf7-4aef-870d-4c8eca1de2a7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1753 microversion: 2.1 time: 0.185855 Jul 28 01:18:12.361983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 276/577] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:12 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:12.662304 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:12.662928 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:12.669757 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:12.670209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:12.671003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:12.671441 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:12.816069 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:12.823928 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1fd496a-19f6-4332-b4d6-3a9b3e3630be tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.165740 Jul 28 01:18:12.824504 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 302/578] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:12 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:12.959130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:12.959632 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:12.966743 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:12.967246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:12.968031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:12.968467 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:13.148641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:13.157022 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-cc1d148b-9e36-4632-bf40-c16a1619ec78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1730 microversion: 2.1 time: 0.202884 Jul 28 01:18:13.157586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 277/579] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:12 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:13.178139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7cb2d0cc-7e14-4c5c-b0ae-a1e517d4a9bd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:13.178762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7cb2d0cc-7e14-4c5c-b0ae-a1e517d4a9bd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:13.185144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7cb2d0cc-7e14-4c5c-b0ae-a1e517d4a9bd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:13.185619 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7cb2d0cc-7e14-4c5c-b0ae-a1e517d4a9bd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:13.186393 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7cb2d0cc-7e14-4c5c-b0ae-a1e517d4a9bd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:13.186827 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7cb2d0cc-7e14-4c5c-b0ae-a1e517d4a9bd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:13.204117 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:13.315902 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7cb2d0cc-7e14-4c5c-b0ae-a1e517d4a9bd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141608 Jul 28 01:18:13.316706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 303/580] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:18:13 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:13.384353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:13.384968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:13.391842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:13.392317 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:13.393092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:13.393536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:13.761872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:13.771190 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6ccbe894-1017-4649-9a2a-7f0d7877abc7 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1756 microversion: 2.1 time: 0.390363 Jul 28 01:18:13.771814 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 278/581] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:13 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1756 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:13.844567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:13.845220 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:13.851898 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:13.852344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:13.853099 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:13.853521 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:14.107526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:14.116005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dd47c640-af62-4b2c-856f-7c2cd29bea1f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.275332 Jul 28 01:18:14.116598 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 304/582] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:13 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:14.896043 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-9d83e01a-a8a8-4405-a8e8-f6cc91e749b0 req-a01583a9-ab2c-47ec-a532-fc65aee1e434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52389b09-fdf8-4c6d-8e9d-474a6f793cf4", "tag": "67c0b2f9-537a-48fb-8cc7-ee1426299bf2"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:14.907015 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-9d83e01a-a8a8-4405-a8e8-f6cc91e749b0 req-a01583a9-ab2c-47ec-a532-fc65aee1e434 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:14.907538 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-9d83e01a-a8a8-4405-a8e8-f6cc91e749b0 req-a01583a9-ab2c-47ec-a532-fc65aee1e434 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:14.919337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-9d83e01a-a8a8-4405-a8e8-f6cc91e749b0 req-a01583a9-ab2c-47ec-a532-fc65aee1e434 service nova] Creating event network-changed:67c0b2f9-537a-48fb-8cc7-ee1426299bf2 for instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 on hv-cinder-81558 Jul 28 01:18:14.924638 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-9d83e01a-a8a8-4405-a8e8-f6cc91e749b0 req-a01583a9-ab2c-47ec-a532-fc65aee1e434 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Jul 28 01:18:14.925233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 279/583] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:15.138741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:15.140655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:15.146971 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:15.147660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:15.148453 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:15.148882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:15.376198 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:15.384571 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-33682f60-fd0d-4710-8f71-a73238450f90 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.250922 Jul 28 01:18:15.385494 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 305/584] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:15 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:16.409911 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:16.410680 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:16.419361 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:16.419966 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:16.421078 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:16.421667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:16.570373 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:16.578537 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2a545a9c-5684-44b1-a312-50f43ef720a9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.175586 Jul 28 01:18:16.579163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 280/585] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:16 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:16.939165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-3b6a8d10-4725-4ec2-99b6-2ee33c56a86d req-e23f7a0b-a1a5-47a5-8ac8-6307cff672d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52389b09-fdf8-4c6d-8e9d-474a6f793cf4", "tag": "67c0b2f9-537a-48fb-8cc7-ee1426299bf2"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:16.944162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:16.950960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3b6a8d10-4725-4ec2-99b6-2ee33c56a86d req-e23f7a0b-a1a5-47a5-8ac8-6307cff672d1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:16.951381 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3b6a8d10-4725-4ec2-99b6-2ee33c56a86d req-e23f7a0b-a1a5-47a5-8ac8-6307cff672d1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:16.962873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-3b6a8d10-4725-4ec2-99b6-2ee33c56a86d req-e23f7a0b-a1a5-47a5-8ac8-6307cff672d1 service nova] Creating event network-changed:67c0b2f9-537a-48fb-8cc7-ee1426299bf2 for instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 on hv-cinder-81558 Jul 28 01:18:16.968011 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-3b6a8d10-4725-4ec2-99b6-2ee33c56a86d req-e23f7a0b-a1a5-47a5-8ac8-6307cff672d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Jul 28 01:18:16.968583 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 306/586] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:17.603711 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:17.604689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:17.607921 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:17.609047 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:17.619244 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:17.619698 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:17.620753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:17.621192 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:17.768780 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:17.780756 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f14b0525-216c-43bb-a761-311d6ccd9907 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.183360 Jul 28 01:18:17.781453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 281/587] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:17 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:18.804109 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:18.804840 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:18.811299 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:18.811748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:18.812514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:18.812946 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:18.953966 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:18.962167 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ee880ab0-1a49-40bd-8526-a261007f055d tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.163272 Jul 28 01:18:18.962757 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 307/588] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:18 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:19.985512 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:19.986147 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:19.995709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:19.996386 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:19.997394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:19.997942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:20.147521 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:20.158847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-935f0f3c-6244-4949-beea-290d38feefdc tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.179127 Jul 28 01:18:20.159581 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 282/589] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:19 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:21.180580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:21.181236 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:21.187942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:21.188385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:21.189189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:21.189625 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:21.322203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:21.329986 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c34cd59-fa02-4949-89c9-0ce6ebcc01d3 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.153506 Jul 28 01:18:21.330566 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 308/590] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:21 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:22.352480 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:22.353103 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:22.355572 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:22.362248 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:22.362725 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:22.363550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:22.363987 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:22.529136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:22.540826 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7576ec21-4211-4930-8959-6fa807f32162 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.192385 Jul 28 01:18:22.541652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 283/591] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:22 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:23.564821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:23.565549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:23.571796 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:23.572236 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:23.572990 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:23.573413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:23.708021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:23.717090 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-78eeab73-9e67-4c54-a1b5-c9e1027b238f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.156147 Jul 28 01:18:23.717663 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 309/592] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:23 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:24.742145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:24.742906 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:24.750135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:24.750587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:24.751412 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:24.751849 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:24.892209 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:24.900209 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c202abe4-ce30-4c87-8559-18149c0b721c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.162994 Jul 28 01:18:24.900756 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 284/593] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:24 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:25.472267 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-49668348-cdf8-4f48-9eac-f4fc4497edc6 req-690c6067-c6f0-423c-acb1-187136661c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183b3616-c163-4cad-a062-6d0637e9d642", "name": "network-vif-plugged", "status": "completed", "tag": "79e0f07f-163d-476a-bcb0-0be5f3ea5eff"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:25.477576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=58 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:25.483692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-49668348-cdf8-4f48-9eac-f4fc4497edc6 req-690c6067-c6f0-423c-acb1-187136661c87 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:25.484253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-49668348-cdf8-4f48-9eac-f4fc4497edc6 req-690c6067-c6f0-423c-acb1-187136661c87 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:25.496136 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-49668348-cdf8-4f48-9eac-f4fc4497edc6 req-690c6067-c6f0-423c-acb1-187136661c87 service nova] Creating event network-vif-plugged:79e0f07f-163d-476a-bcb0-0be5f3ea5eff for instance 183b3616-c163-4cad-a062-6d0637e9d642 on hv-cinder-81558 Jul 28 01:18:25.501429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-49668348-cdf8-4f48-9eac-f4fc4497edc6 req-690c6067-c6f0-423c-acb1-187136661c87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032848 Jul 28 01:18:25.502231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 310/594] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:25.922795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:25.923478 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:25.933958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:25.934440 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:25.935467 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:25.936098 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:26.077904 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:26.085742 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4bfb0fba-6786-4a47-9954-575c4f0a6371 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.167521 Jul 28 01:18:26.086279 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 285/595] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:25 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:27.022820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-10b1ac38-c4fa-41cb-bebe-45e6cd91ad3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:27.023417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-10b1ac38-c4fa-41cb-bebe-45e6cd91ad3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:27.030036 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10b1ac38-c4fa-41cb-bebe-45e6cd91ad3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.030476 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10b1ac38-c4fa-41cb-bebe-45e6cd91ad3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.031245 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10b1ac38-c4fa-41cb-bebe-45e6cd91ad3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.031695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10b1ac38-c4fa-41cb-bebe-45e6cd91ad3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.060698 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-10b1ac38-c4fa-41cb-bebe-45e6cd91ad3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments/480ef22d-dd21-4c38-80e9-ed8fa5f11d7c" status: 200 len: 194 microversion: 2.20 time: 0.042675 Jul 28 01:18:27.061275 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 311/596] 10.222.0.17 () {60 vars in 1454 bytes} [Thu Jul 28 01:18:27 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments/480ef22d-dd21-4c38-80e9-ed8fa5f11d7c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:18:27.106708 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:27.107340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:27.114024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.118187 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.119041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.119481 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.134586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:27.135099 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:27.142203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.142683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.143483 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.143917 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.225422 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lazy-loading 'services' on Instance uuid 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:18:27.258242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:27.265762 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f5dd4318-56b8-4d1b-aeed-a1bc0e7a409e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1260 microversion: 2.1 time: 0.162846 Jul 28 01:18:27.266323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 286/597] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:27 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:27.303062 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c51118b8-b50b-414c-98ad-0905833c4628 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments/480ef22d-dd21-4c38-80e9-ed8fa5f11d7c" status: 202 len: 0 microversion: 2.20 time: 0.172818 Jul 28 01:18:27.303672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 312/598] 10.222.0.17 () {60 vars in 1457 bytes} [Thu Jul 28 01:18:27 2022] DELETE /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments/480ef22d-dd21-4c38-80e9-ed8fa5f11d7c => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 01:18:27.312139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-158098a5-b2b4-48c3-9a5c-559216c90b39 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:27.314435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-158098a5-b2b4-48c3-9a5c-559216c90b39 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:27.320615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-158098a5-b2b4-48c3-9a5c-559216c90b39 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.321066 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-158098a5-b2b4-48c3-9a5c-559216c90b39 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.321831 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-158098a5-b2b4-48c3-9a5c-559216c90b39 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:27.322266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-158098a5-b2b4-48c3-9a5c-559216c90b39 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:27.351952 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-158098a5-b2b4-48c3-9a5c-559216c90b39 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043809 Jul 28 01:18:27.352520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 287/599] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Jul 28 01:18:27 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:18:28.288942 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:28.289604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:28.296102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:28.296551 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:28.297317 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:28.297738 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:28.365215 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f8fd71d7-5bfa-4d7a-a9d5-e366b95d6915 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:28.367455 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f8fd71d7-5bfa-4d7a-a9d5-e366b95d6915 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:28.375822 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f8fd71d7-5bfa-4d7a-a9d5-e366b95d6915 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:28.376376 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f8fd71d7-5bfa-4d7a-a9d5-e366b95d6915 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:28.377294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f8fd71d7-5bfa-4d7a-a9d5-e366b95d6915 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:28.378306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f8fd71d7-5bfa-4d7a-a9d5-e366b95d6915 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:28.414781 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f8fd71d7-5bfa-4d7a-a9d5-e366b95d6915 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053916 Jul 28 01:18:28.415650 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 288/600] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Jul 28 01:18:28 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:18:28.436644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:28.444724 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-70f22df9-00df-470a-86ba-03a1924c901a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1444 microversion: 2.1 time: 0.161657 Jul 28 01:18:28.445304 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 313/601] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:28 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:28.465234 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:28.465848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:28.471872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:28.472322 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:28.473093 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:28.473528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:28.617655 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:28.620116 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:28.628752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d86f25c5-8992-4f60-922c-9a3890fcce8c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1444 microversion: 2.1 time: 0.167428 Jul 28 01:18:28.629383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 289/602] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:28 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:29.427900 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-35bdb3aa-c312-4ac7-8c6b-8972d8f305fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:29.430185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-35bdb3aa-c312-4ac7-8c6b-8972d8f305fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:29.437000 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35bdb3aa-c312-4ac7-8c6b-8972d8f305fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:29.437645 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35bdb3aa-c312-4ac7-8c6b-8972d8f305fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:29.438496 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35bdb3aa-c312-4ac7-8c6b-8972d8f305fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:29.439074 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35bdb3aa-c312-4ac7-8c6b-8972d8f305fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:29.471246 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-35bdb3aa-c312-4ac7-8c6b-8972d8f305fe tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047293 Jul 28 01:18:29.472061 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 314/603] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Jul 28 01:18:29 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:29.537077 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:29.537653 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:29.544664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:29.545114 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:29.545889 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:29.546326 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:29.572333 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:18:29.658296 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b6563735-6903-4b00-9914-d1fe8134ade3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 204 len: 0 microversion: 2.20 time: 0.126060 Jul 28 01:18:29.658918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 290/604] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Jul 28 01:18:29 2022] DELETE /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 01:18:29.667683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:29.668291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:29.674384 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:29.674880 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:29.675843 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:29.676552 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:29.935134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:29.943703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:29.945196 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:29.946366 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1a5838f9-08f3-4f61-a9b4-aa266b7b99c7 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.282670 Jul 28 01:18:29.946984 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 315/605] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:29 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:30.470688 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-65b67253-fecd-4067-af5a-5612636e4a59 req-aec92adc-fd44-4214-8217-31514fdb7f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183b3616-c163-4cad-a062-6d0637e9d642", "tag": "79e0f07f-163d-476a-bcb0-0be5f3ea5eff"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:30.481880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-65b67253-fecd-4067-af5a-5612636e4a59 req-aec92adc-fd44-4214-8217-31514fdb7f81 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:30.482308 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-65b67253-fecd-4067-af5a-5612636e4a59 req-aec92adc-fd44-4214-8217-31514fdb7f81 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:30.494708 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-65b67253-fecd-4067-af5a-5612636e4a59 req-aec92adc-fd44-4214-8217-31514fdb7f81 service nova] Creating event network-changed:79e0f07f-163d-476a-bcb0-0be5f3ea5eff for instance 183b3616-c163-4cad-a062-6d0637e9d642 on hv-cinder-81558 Jul 28 01:18:30.508389 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-65b67253-fecd-4067-af5a-5612636e4a59 req-aec92adc-fd44-4214-8217-31514fdb7f81 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041591 Jul 28 01:18:30.509029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 291/606] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:30.969701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:30.970338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:30.976553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:30.976990 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:30.977756 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:30.978183 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:31.114739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:31.122803 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:31.124309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:31.125593 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-13cd276c-5493-4648-9d99-041dbf195f44 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1723 microversion: 2.20 time: 0.159869 Jul 28 01:18:31.126161 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 316/607] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:30 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:32.151006 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:32.151868 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:32.159950 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:32.160407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:32.161201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:32.161715 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:32.281903 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:32.290794 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:32.292704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:32.293876 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4881f8c5-cc46-467c-8565-fca65b8e0c81 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 200 len: 1656 microversion: 2.20 time: 0.147991 Jul 28 01:18:32.294939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 292/608] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:32 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 1656 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:32.504101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-68404d57-6a63-49ea-b2c3-d8ff95978a67 req-ae7f376a-362f-4e04-9618-ccabc3d2e99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300e3c0c-fb14-4c05-b53a-fe8f0589ac1b", "name": "network-vif-deleted", "tag": "a76b2846-749f-47c3-81f3-a7c5328f00ad"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:32.521711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-68404d57-6a63-49ea-b2c3-d8ff95978a67 req-ae7f376a-362f-4e04-9618-ccabc3d2e99c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:32.522149 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-68404d57-6a63-49ea-b2c3-d8ff95978a67 req-ae7f376a-362f-4e04-9618-ccabc3d2e99c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:32.536167 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-68404d57-6a63-49ea-b2c3-d8ff95978a67 req-ae7f376a-362f-4e04-9618-ccabc3d2e99c service nova] Creating event network-vif-deleted:a76b2846-749f-47c3-81f3-a7c5328f00ad for instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b on hv-cinder-81558 Jul 28 01:18:32.542813 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-68404d57-6a63-49ea-b2c3-d8ff95978a67 req-ae7f376a-362f-4e04-9618-ccabc3d2e99c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042088 Jul 28 01:18:32.543601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 317/609] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:33.317709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:33.318293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:33.325907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:33.326347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:33.327159 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:33.327589 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:33.342472 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] HTTP exception thrown: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Request method failure captured: Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b HTTP/1.1 Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLS006mcG-AuhXZB6dP_YOQnqYmiuPJrAve8SGb53BZ63wLP6I7ZOfFuhKMwIYFuUOXSte-Nib9jiXGUi-VBVJhwnno5C-YX-xuo4G-xIAl4vxS3wW4gxWqD23EdWN_wdg3R8uAYMbz3sABtQCulElNNiQjA-S2YHbV53btgKfDknk Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:18:33.344185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e3df8020ac0427bae99a7fc30bdfa48", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 166cef282cb24a5aaef0ca8b28f02e56 Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:18:33.345864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '300e3c0c-fb14-4c05-b53a-fe8f0589ac1b'} Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:18:33.350335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:18:33.351891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:18:33.353173 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Returning 404 to user: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:18:33.353173 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4b197878-c76c-4075-908f-be17c4573a41 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 404 len: 111 microversion: 2.20 time: 0.031883 Jul 28 01:18:33.353173 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 293/610] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:33 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:18:33.355668 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d086da1a-f8da-403f-8292-52e5653dcef8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '.version_select at 0x7ff71c6e3e50>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:33.378701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d086da1a-f8da-403f-8292-52e5653dcef8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333034081" status: 204 len: 0 microversion: 2.20 time: 0.027358 Jul 28 01:18:33.379334 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 318/611] 10.222.0.17 () {60 vars in 1259 bytes} [Thu Jul 28 01:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333034081 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 01:18:34.239812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-afeed285-6fce-4868-9794-79e1c56f4859 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'create', calling method: .version_select at 0x7ff71c7c2ee0>, body: {"keypair": {"name": "tempest-keypair-312006518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGa3ssunVoBcRnn/Hkh7lWGYRWGkoua/kK9H+B4RFKaiys/cMR/VH7tHKg0gz7/L4k7wzkhL4+ZLGozdNsVLbmqfjxLqYluf8iHv1fsAO3xMEqywlsQd7Nb7dyB8V8Ytdg=="}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:34.256382 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-afeed285-6fce-4868-9794-79e1c56f4859 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:18:34.260472 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-afeed285-6fce-4868-9794-79e1c56f4859 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for user 166cef282cb24a5aaef0ca8b28f02e56 and project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:18:34.289020 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-afeed285-6fce-4868-9794-79e1c56f4859 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053193 Jul 28 01:18:34.289727 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 294/612] 10.222.0.17 () {62 vars in 1200 bytes} [Thu Jul 28 01:18:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 01:18:35.687651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-982663208", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79d1ca3f-e23e-4848-9d9a-982b12f210b8"}], "security_groups": [{"name": "tempest-securitygroup--1488488593"}], "key_name": "tempest-keypair-312006518", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:35.798705 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] validate_networks() for [('79d1ca3f-e23e-4848-9d9a-982b12f210b8', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:18:36.218642 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:18:36.219284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:18:36.219975 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:18:36.220575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:18:36.221203 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:18:36.235282 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:36.235900 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:36.237114 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:36.237667 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:36.256411 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:18:36.260621 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Getting quotas for user 166cef282cb24a5aaef0ca8b28f02e56 and project 6e3df8020ac0427bae99a7fc30bdfa48. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:18:36.272400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:18:36.274747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:18:36.328613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e8831e1f-7748-4770-97bc-7e5bb27bfcdf tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.645429 Jul 28 01:18:36.329232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 319/613] 10.222.0.17 () {62 vars in 1188 bytes} [Thu Jul 28 01:18:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 01:18:36.341358 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b6129687-abd7-4f35-b08f-491da872c589 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:36.341971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b6129687-abd7-4f35-b08f-491da872c589 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:36.401874 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b6129687-abd7-4f35-b08f-491da872c589 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:36.409325 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b6129687-abd7-4f35-b08f-491da872c589 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:36.410930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b6129687-abd7-4f35-b08f-491da872c589 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:36.412124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b6129687-abd7-4f35-b08f-491da872c589 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1280 microversion: 2.20 time: 0.075518 Jul 28 01:18:36.412667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 295/614] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:36 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:37.435175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:37.435771 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:37.442878 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:37.443360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:37.444221 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:37.444681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:37.514877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:37.523748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:37.525224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:37.526313 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a471c24a-d6d6-456f-949b-e7c6ef806bda tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1332 microversion: 2.20 time: 0.095281 Jul 28 01:18:37.526871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 320/615] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:37 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:38.550342 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:38.550991 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:38.558649 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:38.559134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:38.560237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:38.561144 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:38.709353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:38.717656 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:38.719182 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:38.720302 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e36129dc-3e81-4e81-9834-6f4316bf317b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.174682 Jul 28 01:18:38.720864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 296/616] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:38 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:39.145248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-4ac1190d-ebc9-4943-bae2-1c2ff4a1f0c1 req-fad1bc4e-2e22-45c2-8ece-10ccd351b03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035e590-ae9f-4fb3-ac7f-3615a1ce992c", "tag": "bd4676aa-4815-4dd2-8cfe-5bab28819f71"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:39.157166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4ac1190d-ebc9-4943-bae2-1c2ff4a1f0c1 req-fad1bc4e-2e22-45c2-8ece-10ccd351b03d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:39.158139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4ac1190d-ebc9-4943-bae2-1c2ff4a1f0c1 req-fad1bc4e-2e22-45c2-8ece-10ccd351b03d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:39.186928 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-4ac1190d-ebc9-4943-bae2-1c2ff4a1f0c1 req-fad1bc4e-2e22-45c2-8ece-10ccd351b03d service nova] Creating event network-changed:bd4676aa-4815-4dd2-8cfe-5bab28819f71 for instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c on hv-cinder-81558 Jul 28 01:18:39.192335 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-4ac1190d-ebc9-4943-bae2-1c2ff4a1f0c1 req-fad1bc4e-2e22-45c2-8ece-10ccd351b03d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059326 Jul 28 01:18:39.192940 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 321/617] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:39.744424 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:39.745032 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:39.752097 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:39.752566 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:39.753341 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:39.753774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:39.897673 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:39.906183 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:39.908290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:39.909634 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-90999a11-aeb9-4bb7-98a4-ef0ee709b57e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.169703 Jul 28 01:18:39.910168 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 297/618] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:39 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:40.936998 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:40.937666 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:40.944408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:40.944877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:40.945643 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:40.946078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:41.082231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:41.091676 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:41.093464 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:41.094623 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f18e30bb-9abb-4e22-9c6a-734f625d17f0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.162052 Jul 28 01:18:41.095232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 322/619] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:40 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:42.119701 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:42.121351 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:42.128280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:42.128728 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:42.129530 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:42.130341 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:42.267122 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:42.275740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:42.277463 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:42.278795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-22aa56cc-0630-4746-89f2-8c523e524c47 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.163634 Jul 28 01:18:42.279466 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 298/620] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:42 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:43.302177 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:43.302729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:43.309567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:43.310015 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:43.310777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:43.311239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:43.313915 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:43.449328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:43.457915 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:43.459602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:43.460714 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d709056b-56d4-467a-b631-d53c95f828f1 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.162655 Jul 28 01:18:43.461270 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 323/621] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:43 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:44.404352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7e93e05e-ea6d-4df4-ac93-43967d1e7c9f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:44.406651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7e93e05e-ea6d-4df4-ac93-43967d1e7c9f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:44.413660 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e93e05e-ea6d-4df4-ac93-43967d1e7c9f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.414108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e93e05e-ea6d-4df4-ac93-43967d1e7c9f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.414916 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e93e05e-ea6d-4df4-ac93-43967d1e7c9f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.415354 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e93e05e-ea6d-4df4-ac93-43967d1e7c9f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.446029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7e93e05e-ea6d-4df4-ac93-43967d1e7c9f tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045713 Jul 28 01:18:44.446790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 299/622] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:18:44 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:18:44.483306 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:44.483916 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:44.490181 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.490745 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.491549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.491981 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.515729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:44.516231 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:44.522456 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.523191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.523907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.524407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.550678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:18:44.628417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:44.631114 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-00f14ed4-7580-4a4b-879d-fe568b024657 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 204 len: 0 microversion: 2.1 time: 0.118906 Jul 28 01:18:44.631776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 300/623] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:18:44 2022] DELETE /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:18:44.639620 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:44.640946 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:44.641165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:44.641645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:44.642319 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5a7a6037-97ed-49cd-bd11-e11766e41303 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.162946 Jul 28 01:18:44.642901 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 324/624] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:44 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:44.648585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.649032 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.649841 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:44.650275 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:44.781950 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:44.791622 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6166bb17-9dc4-4578-a7b3-73cb4f856cf2 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1674 microversion: 2.1 time: 0.154888 Jul 28 01:18:44.792198 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 301/625] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:44 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:18:45.607740 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-e1f71aa7-6363-4c16-91d8-d799c2239bc3 req-f3f84847-4fb5-4d72-8c3a-66039a621aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035e590-ae9f-4fb3-ac7f-3615a1ce992c", "name": "network-vif-plugged", "status": "completed", "tag": "bd4676aa-4815-4dd2-8cfe-5bab28819f71"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:45.619620 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e1f71aa7-6363-4c16-91d8-d799c2239bc3 req-f3f84847-4fb5-4d72-8c3a-66039a621aaa service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:45.620069 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e1f71aa7-6363-4c16-91d8-d799c2239bc3 req-f3f84847-4fb5-4d72-8c3a-66039a621aaa service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:45.632578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-e1f71aa7-6363-4c16-91d8-d799c2239bc3 req-f3f84847-4fb5-4d72-8c3a-66039a621aaa service nova] Creating event network-vif-plugged:bd4676aa-4815-4dd2-8cfe-5bab28819f71 for instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c on hv-cinder-81558 Jul 28 01:18:45.637895 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-e1f71aa7-6363-4c16-91d8-d799c2239bc3 req-f3f84847-4fb5-4d72-8c3a-66039a621aaa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 Jul 28 01:18:45.638527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 325/626] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:45.665290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:45.665880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:45.672854 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:45.673303 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:45.674086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:45.674521 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:45.810091 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:45.816182 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:45.817118 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:45.821648 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:45.823542 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:45.825218 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1c03b2cc-de14-4210-8da0-8b614a7029e6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.164093 Jul 28 01:18:45.826021 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 302/627] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:45 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:45.826128 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:45.826499 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:45.827352 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:45.827832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:45.961706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:45.969298 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7b16de6f-cec1-459e-b875-ed9977769b34 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1674 microversion: 2.1 time: 0.159087 Jul 28 01:18:45.969855 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 326/628] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:45 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:46.848765 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:46.849373 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:46.851426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:46.857884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:46.858321 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:46.859154 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:46.859593 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:46.990249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:46.990868 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:46.992927 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:46.993605 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:46.999797 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:47.000213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:47.001271 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:47.001710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:47.034349 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:47.042768 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:47.044396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:47.045585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2df36440-9279-4e22-a724-199eee0adee4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.200753 Jul 28 01:18:47.046943 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 303/629] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:46 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:47.132907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:47.140982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a5466bb5-1d9e-4e1e-b63b-196e4df08e32 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1674 microversion: 2.1 time: 0.154960 Jul 28 01:18:47.141537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 327/630] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:46 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:48.069020 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:48.070298 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:48.077735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:48.078257 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:48.079245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:48.079751 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:48.093314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-ad10eb51-9ec8-481f-adc8-e885a555339a req-1395d92e-9920-4ce6-81f9-1067dfd2ed6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3c75a9-eb23-4978-bb95-53fe1e079f36", "name": "network-vif-deleted", "tag": "5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:48.103820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ad10eb51-9ec8-481f-adc8-e885a555339a req-1395d92e-9920-4ce6-81f9-1067dfd2ed6f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:48.104881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ad10eb51-9ec8-481f-adc8-e885a555339a req-1395d92e-9920-4ce6-81f9-1067dfd2ed6f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:48.134515 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-ad10eb51-9ec8-481f-adc8-e885a555339a req-1395d92e-9920-4ce6-81f9-1067dfd2ed6f service nova] Creating event network-vif-deleted:5c8f1f3a-5e33-46e8-ba65-5a6e124b54ef for instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 on hv-cinder-81558 Jul 28 01:18:48.143140 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-ad10eb51-9ec8-481f-adc8-e885a555339a req-1395d92e-9920-4ce6-81f9-1067dfd2ed6f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053458 Jul 28 01:18:48.144047 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 328/631] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:48.165320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:48.166448 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:48.174541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:48.175166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:48.176255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:48.176834 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:48.279443 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:48.282361 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:48.288497 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-379c27c5-643d-42f2-a187-9b9e42c47162 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 200 len: 1607 microversion: 2.1 time: 0.128443 Jul 28 01:18:48.311501 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:48.311501 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:48.311501 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6513318c-be9f-4d2a-9ff8-2a6ef7012406 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1406 microversion: 2.20 time: 0.228903 Jul 28 01:18:48.312214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 304/632] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:48 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:48.313051 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 329/633] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:48 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 1607 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:49.317258 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:49.317807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:49.319054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:49.319682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:49.325062 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:49.325519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:49.325995 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:49.326293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:49.326429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:49.326720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:49.327234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:49.327661 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:49.341661 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] HTTP exception thrown: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Request method failure captured: Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 HTTP/1.1 Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLQNCQE8hDOGbf4fw6aqqod2ZSToBajXpjPsGYdDU_yGCeA6O5abu098UclF9R0y7mwZadpZ6Q0YQHMeRj-9JoHjOUhkTVg9Uiiw40rMHNZI9vtQk94PYAnPSKHaIom8DBCNKLdDpa9fRVDBekG0lkP502-0ENelL2GaDP7B0wEt6M Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:18:49.343378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_347bcdc7636e4f93af2597f853926b13", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: c8ab1df6f15143de8f922a626317fa9c Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:18:49.344871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '0b3c75a9-eb23-4978-bb95-53fe1e079f36'} Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:18:49.347436 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:18:49.349101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:18:49.350376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Returning 404 to user: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:18:49.350376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b3d79da3-af6b-4b86-95a3-c01df303a340 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 404 len: 111 microversion: 2.1 time: 0.029607 Jul 28 01:18:49.350376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 330/634] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:49 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:18:49.353480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b7620209-177f-4733-9998-f21e971181ab tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '.version_select at 0x7ff71c4e13a0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:49.373174 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b7620209-177f-4733-9998-f21e971181ab tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-841192381" status: 202 len: 0 microversion: 2.1 time: 0.023111 Jul 28 01:18:49.373766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 331/635] 10.222.0.17 () {58 vars in 1218 bytes} [Thu Jul 28 01:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-841192381 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 01:18:49.461907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:49.470203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:49.471751 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:49.472934 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a3cb8e6c-16a8-402f-8f9d-604aa221dd75 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1598 microversion: 2.20 time: 0.159814 Jul 28 01:18:49.484130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 305/636] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:18:49 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:18:49.495459 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f251e59f-a80d-48a0-aef7-7135e771e773 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:49.495950 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f251e59f-a80d-48a0-aef7-7135e771e773 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:49.503669 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f251e59f-a80d-48a0-aef7-7135e771e773 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:49.504125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f251e59f-a80d-48a0-aef7-7135e771e773 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:49.505269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f251e59f-a80d-48a0-aef7-7135e771e773 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:49.505800 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f251e59f-a80d-48a0-aef7-7135e771e773 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:49.593913 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f251e59f-a80d-48a0-aef7-7135e771e773 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102503 Jul 28 01:18:49.594507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 332/637] 10.222.0.17 () {60 vars in 1316 bytes} [Thu Jul 28 01:18:49 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:18:49.986867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2d043625-cef2-4263-bb14-b3ae100830fe tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'create', calling method: .version_select at 0x7ff71c58d9d0>, body: {"keypair": {"name": "tempest-keypair-1542252289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWAhVfS9ZS2aPQVPoBFWKCecvBFN3Qx4OGtsM3yqKDgtY9r/kIofOkMkGgrDZTxp7yCMjL8L7beBh8zoqnAIWTQGSq77KUARl77XINjfKX3lAGzUYgJ1NF8UaGeIoM+cg=="}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:50.003830 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-2d043625-cef2-4263-bb14-b3ae100830fe tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for project 347bcdc7636e4f93af2597f853926b13. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:18:50.008377 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-2d043625-cef2-4263-bb14-b3ae100830fe tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for user c8ab1df6f15143de8f922a626317fa9c and project 347bcdc7636e4f93af2597f853926b13. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:18:50.033341 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2d043625-cef2-4263-bb14-b3ae100830fe tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050317 Jul 28 01:18:50.033956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 306/638] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:18:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:50.853572 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-639805a3-7209-4519-9b83-7039f4d13b2a req-716b16d6-b651-4f8b-9a38-bb17ca74c0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035e590-ae9f-4fb3-ac7f-3615a1ce992c", "tag": "bd4676aa-4815-4dd2-8cfe-5bab28819f71"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:50.864284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-639805a3-7209-4519-9b83-7039f4d13b2a req-716b16d6-b651-4f8b-9a38-bb17ca74c0ba service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:50.864776 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-639805a3-7209-4519-9b83-7039f4d13b2a req-716b16d6-b651-4f8b-9a38-bb17ca74c0ba service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:50.879146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-639805a3-7209-4519-9b83-7039f4d13b2a req-716b16d6-b651-4f8b-9a38-bb17ca74c0ba service nova] Creating event network-changed:bd4676aa-4815-4dd2-8cfe-5bab28819f71 for instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c on hv-cinder-81558 Jul 28 01:18:50.885074 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-639805a3-7209-4519-9b83-7039f4d13b2a req-716b16d6-b651-4f8b-9a38-bb17ca74c0ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035415 Jul 28 01:18:50.889350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 333/639] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:51.337035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-611690573", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8b9b78b-8c4e-43b1-bef2-ab7b40ebdc5e"}], "security_groups": [{"name": "tempest-securitygroup--1227503230"}], "key_name": "tempest-keypair-1542252289", "user_data": "}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:51.497549 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] validate_networks() for [('a8b9b78b-8c4e-43b1-bef2-ab7b40ebdc5e', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:18:51.941942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:18:51.942397 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:18:51.942907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:18:51.943318 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:18:51.943725 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:18:51.953446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:51.954081 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:51.954947 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:51.955388 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:51.975405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for project 347bcdc7636e4f93af2597f853926b13. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:18:51.979464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Getting quotas for user c8ab1df6f15143de8f922a626317fa9c and project 347bcdc7636e4f93af2597f853926b13. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:18:51.990336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:18:51.992761 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:18:52.042337 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b1e0f9a8-bb00-44f3-a251-6af9305b6a0c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.710106 Jul 28 01:18:52.043019 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 307/640] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:18:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:18:52.054554 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4a79e275-8630-49e1-9e00-c6da8e602667 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:52.055481 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4a79e275-8630-49e1-9e00-c6da8e602667 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:52.114792 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a79e275-8630-49e1-9e00-c6da8e602667 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:52.122420 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4a79e275-8630-49e1-9e00-c6da8e602667 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1237 microversion: 2.1 time: 0.072136 Jul 28 01:18:52.123031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 334/641] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:52 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:18:53.213550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:53.215037 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:53.217308 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:53.227545 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:53.228262 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:53.229363 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:53.229947 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:53.235639 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:53.311151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:53.320793 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-59ad9a3d-320b-4cdf-a9b0-a0e0275f8708 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1307 microversion: 2.1 time: 0.180122 Jul 28 01:18:53.321374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 308/642] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:53 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:54.341957 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:54.342682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:54.349588 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:54.350134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:54.351032 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:54.351469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:54.584546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:54.592525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fb5b470f-c9df-422e-b285-8f3f94f7d83e tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.254425 Jul 28 01:18:54.593109 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 335/643] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:54 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:54.759035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-674d4b38-1bc9-4321-9fab-b47be3a6cc92 req-78f830f7-0c50-4e1e-bccb-91fe6d7a55e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee97a8c0-2311-4bee-a11d-43aed93845f6", "tag": "54ea0962-d401-489d-86eb-52f3bf0b9f65"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:54.776034 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-674d4b38-1bc9-4321-9fab-b47be3a6cc92 req-78f830f7-0c50-4e1e-bccb-91fe6d7a55e3 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:54.776864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-674d4b38-1bc9-4321-9fab-b47be3a6cc92 req-78f830f7-0c50-4e1e-bccb-91fe6d7a55e3 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:54.793599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-674d4b38-1bc9-4321-9fab-b47be3a6cc92 req-78f830f7-0c50-4e1e-bccb-91fe6d7a55e3 service nova] Creating event network-changed:54ea0962-d401-489d-86eb-52f3bf0b9f65 for instance ee97a8c0-2311-4bee-a11d-43aed93845f6 on hv-cinder-81558 Jul 28 01:18:54.800106 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-674d4b38-1bc9-4321-9fab-b47be3a6cc92 req-78f830f7-0c50-4e1e-bccb-91fe6d7a55e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045435 Jul 28 01:18:54.800716 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 309/644] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:54.910715 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:54.911628 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:54.919136 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:54.919596 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:54.920578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:54.921040 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:55.003112 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lazy-loading 'services' on Instance uuid 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:18:55.080519 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5c5ca5ed-cd9c-45f1-9c43-8e7d5da09b35 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments/bbd91aa1-891a-48d3-8215-767dcea2ac74" status: 202 len: 0 microversion: 2.1 time: 0.174127 Jul 28 01:18:55.081296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 336/645] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:18:54 2022] DELETE /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments/bbd91aa1-891a-48d3-8215-767dcea2ac74 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:18:55.099937 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-902e6f8c-3aa6-4c10-a3d0-4bc79105b8ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:55.102382 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-902e6f8c-3aa6-4c10-a3d0-4bc79105b8ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:55.110207 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-902e6f8c-3aa6-4c10-a3d0-4bc79105b8ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:55.111051 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-902e6f8c-3aa6-4c10-a3d0-4bc79105b8ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:55.111917 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-902e6f8c-3aa6-4c10-a3d0-4bc79105b8ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:55.112465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-902e6f8c-3aa6-4c10-a3d0-4bc79105b8ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:55.143614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-902e6f8c-3aa6-4c10-a3d0-4bc79105b8ef tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057701 Jul 28 01:18:55.144178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 310/646] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:18:55 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:55.615163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:55.615842 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:55.617852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:55.624330 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:55.624821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:55.625585 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:55.625994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:55.659435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-694084589"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:55.659975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:55.666893 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:55.667342 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:55.668120 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:55.668557 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:55.818671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:55.826794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7aea0f51-4344-4bcc-83f4-91db10646855 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.216010 Jul 28 01:18:55.827410 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 337/647] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:55 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:55.853059 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.network.security_group_api [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Removing security group dc06e2eb-a2eb-47c1-b95a-e012ec978612 from port 6f17787d-ed77-4892-b415-19e790741366 Jul 28 01:18:56.156347 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d1954d5-766b-42d3-beb7-f863b473928c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:56.158654 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d1954d5-766b-42d3-beb7-f863b473928c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:56.164995 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1954d5-766b-42d3-beb7-f863b473928c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:56.165498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1954d5-766b-42d3-beb7-f863b473928c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:56.166292 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1954d5-766b-42d3-beb7-f863b473928c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:56.166729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1954d5-766b-42d3-beb7-f863b473928c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:56.196796 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d1954d5-766b-42d3-beb7-f863b473928c tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Jul 28 01:18:56.197364 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 338/648] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:18:56 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:56.251505 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-40ca18dc-a284-4a0f-9263-4b4adaa196b8 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/action" status: 202 len: 0 microversion: 2.1 time: 0.595955 Jul 28 01:18:56.257716 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 311/649] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:18:55 2022] POST /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 01:18:56.848814 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:56.849453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:56.856601 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:56.857195 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:56.857974 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:56.858409 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:56.876036 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-3f77e3bf-7127-408e-9d02-979752973e0d req-7eacc761-c60a-4815-aeb8-13da65bdfc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c015e542-38ce-4335-bfa4-f9c77444f42f", "tag": "6f17787d-ed77-4892-b415-19e790741366"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:56.886897 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3f77e3bf-7127-408e-9d02-979752973e0d req-7eacc761-c60a-4815-aeb8-13da65bdfc7c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:56.887546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3f77e3bf-7127-408e-9d02-979752973e0d req-7eacc761-c60a-4815-aeb8-13da65bdfc7c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:56.900101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-3f77e3bf-7127-408e-9d02-979752973e0d req-7eacc761-c60a-4815-aeb8-13da65bdfc7c service nova] Creating event network-changed:6f17787d-ed77-4892-b415-19e790741366 for instance c015e542-38ce-4335-bfa4-f9c77444f42f on hv-cinder-81558 Jul 28 01:18:56.905307 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-3f77e3bf-7127-408e-9d02-979752973e0d req-7eacc761-c60a-4815-aeb8-13da65bdfc7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093233 Jul 28 01:18:56.905925 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 339/650] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:57.146317 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:57.155346 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ad6a0624-5f10-4547-a53b-457b5c0a61c5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.311716 Jul 28 01:18:57.156278 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 312/651] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:56 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:57.211838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1e4fe772-4d6a-4ebc-9e86-af8a18928fcb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:57.215190 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1e4fe772-4d6a-4ebc-9e86-af8a18928fcb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:57.224427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4fe772-4d6a-4ebc-9e86-af8a18928fcb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:57.225438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4fe772-4d6a-4ebc-9e86-af8a18928fcb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:57.227072 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4fe772-4d6a-4ebc-9e86-af8a18928fcb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:57.227754 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4fe772-4d6a-4ebc-9e86-af8a18928fcb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:57.259986 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1e4fe772-4d6a-4ebc-9e86-af8a18928fcb tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054070 Jul 28 01:18:57.261146 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 340/652] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:18:57 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:18:57.339253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:57.340137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:57.347031 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:57.347892 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:57.349301 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:57.349624 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:57.378810 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:18:57.480709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5253e99e-e899-4177-948c-0df7c968489d tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 204 len: 0 microversion: 2.1 time: 0.144835 Jul 28 01:18:57.481342 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 313/653] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:18:57 2022] DELETE /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:18:57.491073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:57.493261 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:57.502330 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:57.502928 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:57.503973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:57.504508 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:57.939303 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:57.948399 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2a9bfc78-5f0b-41fb-95f9-caa074dbef42 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1690 microversion: 2.1 time: 0.462467 Jul 28 01:18:57.948981 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 341/654] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:57 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1690 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:18:58.138827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:58.140229 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:58.147367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.147998 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.148890 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.149425 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.177391 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:58.178322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:58.185263 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.185385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.186160 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.186801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.240651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lazy-loading 'services' on Instance uuid c015e542-38ce-4335-bfa4-f9c77444f42f {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:18:58.326157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:58.334357 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-caff948b-7e2d-4dfd-96a8-56e98db27b85 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.160819 Jul 28 01:18:58.334971 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 342/655] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:58 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:18:58.367968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b99fb1ed-02a7-45f8-980e-c8cce024ec3b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments/efe4348f-b53a-4592-aae2-b519ce9ce366" status: 202 len: 0 microversion: 2.1 time: 0.235345 Jul 28 01:18:58.368841 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 314/656] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:18:58 2022] DELETE /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments/efe4348f-b53a-4592-aae2-b519ce9ce366 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:18:58.377977 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-293ec9cf-fb55-4273-a728-d6c31085b914 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:58.380740 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-293ec9cf-fb55-4273-a728-d6c31085b914 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:58.388032 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-293ec9cf-fb55-4273-a728-d6c31085b914 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.388484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-293ec9cf-fb55-4273-a728-d6c31085b914 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.389260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-293ec9cf-fb55-4273-a728-d6c31085b914 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.389728 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-293ec9cf-fb55-4273-a728-d6c31085b914 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.420552 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-293ec9cf-fb55-4273-a728-d6c31085b914 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046842 Jul 28 01:18:58.421543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 343/657] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:18:58 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:58.923294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-f932c230-7a0d-40b2-a9b7-b9e497357274 req-83e159d7-90ee-4262-a055-c8bed877164d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c015e542-38ce-4335-bfa4-f9c77444f42f", "tag": "6f17787d-ed77-4892-b415-19e790741366"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:58.933589 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-f932c230-7a0d-40b2-a9b7-b9e497357274 req-83e159d7-90ee-4262-a055-c8bed877164d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.934025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-f932c230-7a0d-40b2-a9b7-b9e497357274 req-83e159d7-90ee-4262-a055-c8bed877164d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.945865 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-f932c230-7a0d-40b2-a9b7-b9e497357274 req-83e159d7-90ee-4262-a055-c8bed877164d service nova] Creating event network-changed:6f17787d-ed77-4892-b415-19e790741366 for instance c015e542-38ce-4335-bfa4-f9c77444f42f on hv-cinder-81558 Jul 28 01:18:58.951056 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-f932c230-7a0d-40b2-a9b7-b9e497357274 req-83e159d7-90ee-4262-a055-c8bed877164d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032239 Jul 28 01:18:58.951715 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 315/658] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:58.969879 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:58.970489 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:58.976864 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.977313 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:58.978215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:58.978655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:59.117255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:59.119868 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:18:59.127501 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-38665b4b-14dd-45d6-b93a-363183e05067 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1690 microversion: 2.1 time: 0.161681 Jul 28 01:18:59.128320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 344/659] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:58 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:59.357037 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:59.357783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:59.364392 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:59.364848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:59.365596 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:59.366023 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:59.435695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2b32f6bd-2846-45eb-8ebc-3f30b62b1075 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:18:59.437770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2b32f6bd-2846-45eb-8ebc-3f30b62b1075 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:18:59.444534 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2b32f6bd-2846-45eb-8ebc-3f30b62b1075 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:59.444982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2b32f6bd-2846-45eb-8ebc-3f30b62b1075 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:59.445781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2b32f6bd-2846-45eb-8ebc-3f30b62b1075 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:59.446315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2b32f6bd-2846-45eb-8ebc-3f30b62b1075 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:59.484371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2b32f6bd-2846-45eb-8ebc-3f30b62b1075 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054345 Jul 28 01:18:59.485009 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 345/660] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:18:59 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:18:59.525118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:18:59.533003 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9de4de28-2c2e-40d2-909e-45e83e8e672a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.180734 Jul 28 01:18:59.533795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 316/661] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:18:59 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:18:59.662149 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-54bf9a3a-c324-43ed-a7d1-5981be1c8691 req-9997985c-8475-43fd-8367-976dec315f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee97a8c0-2311-4bee-a11d-43aed93845f6", "name": "network-vif-plugged", "status": "completed", "tag": "54ea0962-d401-489d-86eb-52f3bf0b9f65"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:18:59.672123 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-54bf9a3a-c324-43ed-a7d1-5981be1c8691 req-9997985c-8475-43fd-8367-976dec315f57 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:18:59.672563 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-54bf9a3a-c324-43ed-a7d1-5981be1c8691 req-9997985c-8475-43fd-8367-976dec315f57 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:18:59.685080 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-54bf9a3a-c324-43ed-a7d1-5981be1c8691 req-9997985c-8475-43fd-8367-976dec315f57 service nova] Creating event network-vif-plugged:54ea0962-d401-489d-86eb-52f3bf0b9f65 for instance ee97a8c0-2311-4bee-a11d-43aed93845f6 on hv-cinder-81558 Jul 28 01:18:59.690696 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-54bf9a3a-c324-43ed-a7d1-5981be1c8691 req-9997985c-8475-43fd-8367-976dec315f57 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032798 Jul 28 01:18:59.691279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 346/662] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:00.150085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:00.150718 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:00.157413 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:00.157860 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:00.158620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:00.159085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:00.300447 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:00.308201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8cc59503-8867-4183-9897-7f162c9b5e78 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1690 microversion: 2.1 time: 0.162134 Jul 28 01:19:00.308768 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 317/663] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:00 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:00.502163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12ef5f89-3103-415c-8660-e1d2bc28176f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:00.505935 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12ef5f89-3103-415c-8660-e1d2bc28176f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:00.513587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12ef5f89-3103-415c-8660-e1d2bc28176f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:00.514036 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12ef5f89-3103-415c-8660-e1d2bc28176f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:00.514815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12ef5f89-3103-415c-8660-e1d2bc28176f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:00.515291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12ef5f89-3103-415c-8660-e1d2bc28176f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:00.545007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-12ef5f89-3103-415c-8660-e1d2bc28176f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050080 Jul 28 01:19:00.545566 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 347/664] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:19:00 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:00.555551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:00.556604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:00.566215 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:00.566886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:00.568107 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:00.568637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:00.717191 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:00.728428 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dd022ad6-a135-4049-9b42-8cf8a34d0f17 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.178320 Jul 28 01:19:00.729717 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 318/665] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:00 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:01.329689 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:01.330301 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:01.336903 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:01.337322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:01.338234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:01.338534 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:01.485385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:01.493417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-237e7e18-29f9-4844-b823-ded975720e14 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1690 microversion: 2.1 time: 0.167270 Jul 28 01:19:01.506863 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 348/666] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:01 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:01.557654 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6be1f073-07c8-43ed-9de1-f52165515a5b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:01.560115 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6be1f073-07c8-43ed-9de1-f52165515a5b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:01.567641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6be1f073-07c8-43ed-9de1-f52165515a5b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:01.568171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6be1f073-07c8-43ed-9de1-f52165515a5b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:01.569011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6be1f073-07c8-43ed-9de1-f52165515a5b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:01.569646 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6be1f073-07c8-43ed-9de1-f52165515a5b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:01.599112 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6be1f073-07c8-43ed-9de1-f52165515a5b tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Jul 28 01:19:01.599759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 319/667] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:19:01 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:01.750196 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:01.750809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:01.758071 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:01.758528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:01.759490 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:01.759924 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:01.988309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:01.997472 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59b1e463-cc02-4b95-bb74-e79d9d6bd96a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.251195 Jul 28 01:19:01.998389 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 349/668] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:01 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:02.387149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-1c045cfc-1fc1-429c-ac3c-f9caae877efd req-12f906dd-fb2a-4330-a3c8-112fbda4e20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52389b09-fdf8-4c6d-8e9d-474a6f793cf4", "name": "network-vif-deleted", "tag": "67c0b2f9-537a-48fb-8cc7-ee1426299bf2"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:02.392022 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:02.392936 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=10 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:02.399328 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-1c045cfc-1fc1-429c-ac3c-f9caae877efd req-12f906dd-fb2a-4330-a3c8-112fbda4e20c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.399723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-1c045cfc-1fc1-429c-ac3c-f9caae877efd req-12f906dd-fb2a-4330-a3c8-112fbda4e20c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.411489 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-1c045cfc-1fc1-429c-ac3c-f9caae877efd req-12f906dd-fb2a-4330-a3c8-112fbda4e20c service nova] Creating event network-vif-deleted:67c0b2f9-537a-48fb-8cc7-ee1426299bf2 for instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 on hv-cinder-81558 Jul 28 01:19:02.416358 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-1c045cfc-1fc1-429c-ac3c-f9caae877efd req-12f906dd-fb2a-4330-a3c8-112fbda4e20c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032828 Jul 28 01:19:02.417430 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 320/669] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:02.519869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:02.520600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:02.523954 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:02.532898 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.533847 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.535155 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.536095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.575710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.576262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.577102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lazy-loading 'fault' on Instance uuid 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:19:02.613142 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-14e8d998-ad7e-40ff-a90d-830116e69859 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:02.615401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-14e8d998-ad7e-40ff-a90d-830116e69859 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:02.622744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14e8d998-ad7e-40ff-a90d-830116e69859 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.623596 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14e8d998-ad7e-40ff-a90d-830116e69859 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.624739 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14e8d998-ad7e-40ff-a90d-830116e69859 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.625372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14e8d998-ad7e-40ff-a90d-830116e69859 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.633178 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:02.646656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-020afef7-17e0-430d-be5e-3451d3c89843 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 200 len: 1336 microversion: 2.1 time: 0.132096 Jul 28 01:19:02.648009 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 350/670] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:02 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 1336 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:02.661863 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-14e8d998-ad7e-40ff-a90d-830116e69859 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053852 Jul 28 01:19:02.662434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 321/671] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:19:02 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 01:19:02.673100 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:02.673601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:02.679719 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.680171 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.681011 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:02.681447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:02.757871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] HTTP exception thrown: Instance c015e542-38ce-4335-bfa4-f9c77444f42f is not attached to volume efe4348f-b53a-4592-aae2-b519ce9ce366 Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Request method failure captured: Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments/efe4348f-b53a-4592-aae2-b519ce9ce366 HTTP/1.1 Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eNHl4wBSbDmsj4O-zOmCPMNGHJDz6wDpponhJRl8jCM0LSSoCa897jbayIJ-HER3gks1lSN8KKZRwcIrqupE4j7Biw6iWCyjuaegREI-Sx6xkvFvgtOfUFNvATBSjtBDQxemBbkY0Grt9art_T8n9dx1UXYN2GmL16AYikCTkaLFHw Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 9889594f4bf84c4591714b505f1861fe Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-TestMinimumBasicScenario-381370090 Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:19:02.767760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9889594f4bf84c4591714b505f1861fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9889594f4bf84c4591714b505f1861fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9889594f4bf84c4591714b505f1861fe", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9889594f4bf84c4591714b505f1861fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-TestMinimumBasicScenario-381370090 Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 9889594f4bf84c4591714b505f1861fe Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381370090 Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-TestMinimumBasicScenario-381370090-project Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 70b75ae15822428f916c3403f9a67225 Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-TestMinimumBasicScenario-381370090-project Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:19:02.769402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance c015e542-38ce-4335-bfa4-f9c77444f42f is not attached to volume efe4348f-b53a-4592-aae2-b519ce9ce366 Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'server_id': 'c015e542-38ce-4335-bfa4-f9c77444f42f', 'id': 'efe4348f-b53a-4592-aae2-b519ce9ce366'} Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id efe4348f-b53a-4592-aae2-b519ce9ce366. Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:19:02.770244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c015e542-38ce-4335-bfa4-f9c77444f42f is not attached to volume efe4348f-b53a-4592-aae2-b519ce9ce366 Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c015e542-38ce-4335-bfa4-f9c77444f42f is not attached to volume efe4348f-b53a-4592-aae2-b519ce9ce366 Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:02.771688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Returning 404 to user: Instance c015e542-38ce-4335-bfa4-f9c77444f42f is not attached to volume efe4348f-b53a-4592-aae2-b519ce9ce366 {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:19:02.772586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d6270b80-ff64-4042-8120-46afceb9e98a tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments/efe4348f-b53a-4592-aae2-b519ce9ce366" status: 404 len: 154 microversion: 2.1 time: 0.100518 Jul 28 01:19:02.772586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 351/672] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:19:02 2022] DELETE /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f/os-volume_attachments/efe4348f-b53a-4592-aae2-b519ce9ce366 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:19:03.018159 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:03.019036 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:03.029241 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:03.030423 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:03.035008 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:03.035713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:03.194654 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:03.202736 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c8f427ad-fcc6-4cf2-a4fc-dbe791cfbe5b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1363 microversion: 2.1 time: 0.188617 Jul 28 01:19:03.203360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 322/673] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:03 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:03.669078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:03.669688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 52389b09-fdf8-4c6d-8e9d-474a6f793cf4] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:03.676123 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:03.676565 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:03.677334 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:03.677768 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:03.692050 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] HTTP exception thrown: Instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 could not be found. Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Request method failure captured: Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 HTTP/1.1 Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLP45uroqJY4tOsw7MzTomogGWczHPDBPjWIO4CSfNcgqhyAZkGNfMAc1Lcng3yx2yG0MrSBbkOLlmT4zOZMqI_5XzYT1aMh3SmbedkYL5v7LOhTHKjqJ180qmpftqTXj8-ryE0chsIPWl-kLy3n4x47dkOY2VUMTOGAnfMLyF6vJU Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:19:03.693601 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af4689d2f0ef4d71a1c465610011f2d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 018eb80709e94d5e8653fb6eeb342c54 Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 could not be found. Jul 28 01:19:03.695318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '52389b09-fdf8-4c6d-8e9d-474a6f793cf4'} Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 could not be found. Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:19:03.696276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 could not be found. Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 could not be found. Jul 28 01:19:03.697711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:03.699211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Returning 404 to user: Instance 52389b09-fdf8-4c6d-8e9d-474a6f793cf4 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:19:03.699211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-52143670-9fca-4c9e-b747-af3011f02da4 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4" status: 404 len: 111 microversion: 2.1 time: 0.030707 Jul 28 01:19:03.699211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 352/674] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:03 2022] GET /compute/v2.1/servers/52389b09-fdf8-4c6d-8e9d-474a6f793cf4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:19:03.704167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2583dd3d-4fba-469d-ad1b-4259f2b72d11 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '.version_select at 0x7ff71c7c2b80>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:03.725837 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2583dd3d-4fba-469d-ad1b-4259f2b72d11 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080884589" status: 202 len: 0 microversion: 2.1 time: 0.025507 Jul 28 01:19:03.726432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 323/675] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Jul 28 01:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080884589 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:19:03.923533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:03.924553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:03.934504 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:03.935133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:03.935770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:03.936208 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:03.964656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:19:04.056527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a63f64d-ea16-4395-8062-a214027f05bb tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 204 len: 0 microversion: 2.1 time: 0.140017 Jul 28 01:19:04.057194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 353/676] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:19:03 2022] DELETE /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:19:04.067313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:04.067930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:04.075753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:04.076177 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:04.077196 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:04.077669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:04.225001 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:04.225821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:04.232428 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:04.233014 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:04.233695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:04.234131 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:04.335417 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:04.344282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fb306312-560c-4a16-9e9f-db662d01aa1f tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1552 microversion: 2.1 time: 0.281880 Jul 28 01:19:04.345370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 324/677] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:04 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1552 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:04.447498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:04.455598 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-171a591e-ad2b-4f91-b24a-2c8263e8347d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1549 microversion: 2.1 time: 0.234844 Jul 28 01:19:04.456177 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 354/678] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:04 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:04.477902 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e64130d3-2428-4d4d-a725-9b7bc6f292e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:04.478402 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e64130d3-2428-4d4d-a725-9b7bc6f292e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:04.485511 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64130d3-2428-4d4d-a725-9b7bc6f292e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:04.486051 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64130d3-2428-4d4d-a725-9b7bc6f292e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:04.487095 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64130d3-2428-4d4d-a725-9b7bc6f292e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:04.487539 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e64130d3-2428-4d4d-a725-9b7bc6f292e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:04.609824 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e64130d3-2428-4d4d-a725-9b7bc6f292e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136138 Jul 28 01:19:04.610431 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 325/679] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:19:04 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:05.367766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:05.368458 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:05.374876 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:05.375583 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:05.376529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:05.376968 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:05.518823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:05.527450 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d789b04-a5d6-4efc-beff-b23b427842f5 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1552 microversion: 2.1 time: 0.163546 Jul 28 01:19:05.528123 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 355/680] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:05 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:05.629620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-d9397765-a7bd-4bf4-a754-182f5d7c7060 req-da81d0ac-a32a-47d2-9211-87eb9709c163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee97a8c0-2311-4bee-a11d-43aed93845f6", "tag": "54ea0962-d401-489d-86eb-52f3bf0b9f65"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:05.644251 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d9397765-a7bd-4bf4-a754-182f5d7c7060 req-da81d0ac-a32a-47d2-9211-87eb9709c163 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:05.644795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d9397765-a7bd-4bf4-a754-182f5d7c7060 req-da81d0ac-a32a-47d2-9211-87eb9709c163 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:05.647916 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:05.659454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-d9397765-a7bd-4bf4-a754-182f5d7c7060 req-da81d0ac-a32a-47d2-9211-87eb9709c163 service nova] Creating event network-changed:54ea0962-d401-489d-86eb-52f3bf0b9f65 for instance ee97a8c0-2311-4bee-a11d-43aed93845f6 on hv-cinder-81558 Jul 28 01:19:05.665334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-d9397765-a7bd-4bf4-a754-182f5d7c7060 req-da81d0ac-a32a-47d2-9211-87eb9709c163 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040215 Jul 28 01:19:05.665942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 326/681] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:06.542992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-dc0d5450-5a6b-4810-8708-c3640ce25a4d req-2048a52c-b382-4a45-9752-5a153c309537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c015e542-38ce-4335-bfa4-f9c77444f42f", "name": "network-vif-deleted", "tag": "6f17787d-ed77-4892-b415-19e790741366"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:06.553820 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-dc0d5450-5a6b-4810-8708-c3640ce25a4d req-2048a52c-b382-4a45-9752-5a153c309537 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:06.554263 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-dc0d5450-5a6b-4810-8708-c3640ce25a4d req-2048a52c-b382-4a45-9752-5a153c309537 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:06.568183 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-dc0d5450-5a6b-4810-8708-c3640ce25a4d req-2048a52c-b382-4a45-9752-5a153c309537 service nova] Creating event network-vif-deleted:6f17787d-ed77-4892-b415-19e790741366 for instance c015e542-38ce-4335-bfa4-f9c77444f42f on hv-cinder-81558 Jul 28 01:19:06.574396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:06.574637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-dc0d5450-5a6b-4810-8708-c3640ce25a4d req-2048a52c-b382-4a45-9752-5a153c309537 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035885 Jul 28 01:19:06.574637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 356/682] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:19:06.578264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:06.586291 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:06.587111 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:06.588194 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:06.588848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:06.664323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b75ae15822428f916c3403f9a67225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9889594f4bf84c4591714b505f1861fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:06.673384 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d01d79c3-f212-4ee5-93df-81fe4b4c1f11 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 200 len: 1343 microversion: 2.1 time: 0.127896 Jul 28 01:19:06.674306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 327/683] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:06 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 1343 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:19:06.916871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:06.917560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:06.924164 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:06.924609 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:06.925396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:06.925832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:06.952692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:19:07.040371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2253cf91-2de9-4ec9-8ab4-4e4536c2d171 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 204 len: 0 microversion: 2.1 time: 0.127726 Jul 28 01:19:07.040962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 357/684] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:19:06 2022] DELETE /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:19:07.049086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:07.049695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:07.056010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:07.056392 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:07.057165 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:07.057592 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:07.201761 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:07.210100 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-57545246-34c6-4b35-9041-a5b73a96cd75 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1507 microversion: 2.1 time: 0.164810 Jul 28 01:19:07.210695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 328/685] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:07 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:07.697320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:07.698142 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] [instance: c015e542-38ce-4335-bfa4-f9c77444f42f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:07.705371 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:07.705842 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:07.706822 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:07.707290 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:07.722153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] HTTP exception thrown: Instance c015e542-38ce-4335-bfa4-f9c77444f42f could not be found. Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Request method failure captured: Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f HTTP/1.1 Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eNHl4wBSbDmsj4O-zOmCPMNGHJDz6wDpponhJRl8jCM0LSSoCa897jbayIJ-HER3gks1lSN8KKZRwcIrqupE4j7Biw6iWCyjuaegREI-Sx6xkvFvgtOfUFNvATBSjtBDQxemBbkY0Grt9art_T8n9dx1UXYN2GmL16AYikCTkaLFHw Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 9889594f4bf84c4591714b505f1861fe Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-TestMinimumBasicScenario-381370090 Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:19:07.723852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9889594f4bf84c4591714b505f1861fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9889594f4bf84c4591714b505f1861fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9889594f4bf84c4591714b505f1861fe", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9889594f4bf84c4591714b505f1861fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-TestMinimumBasicScenario-381370090 Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 9889594f4bf84c4591714b505f1861fe Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381370090 Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-TestMinimumBasicScenario-381370090-project Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 70b75ae15822428f916c3403f9a67225 Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-TestMinimumBasicScenario-381370090-project Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance c015e542-38ce-4335-bfa4-f9c77444f42f could not be found. Jul 28 01:19:07.725405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'c015e542-38ce-4335-bfa4-f9c77444f42f'} Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c015e542-38ce-4335-bfa4-f9c77444f42f could not be found. Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:19:07.726258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c015e542-38ce-4335-bfa4-f9c77444f42f could not be found. Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c015e542-38ce-4335-bfa4-f9c77444f42f could not be found. Jul 28 01:19:07.727677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:07.729262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Returning 404 to user: Instance c015e542-38ce-4335-bfa4-f9c77444f42f could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:19:07.729262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ec4e1120-9484-4611-b78d-a9082bb69469 tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f" status: 404 len: 111 microversion: 2.1 time: 0.034652 Jul 28 01:19:07.729262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 358/686] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:07 2022] GET /compute/v2.1/servers/c015e542-38ce-4335-bfa4-f9c77444f42f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:19:07.734500 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e12abe74-4d8e-4471-8cef-948bc5cc69ff tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] Calling method '.version_select at 0x7ff71c7c2550>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:07.761607 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e12abe74-4d8e-4471-8cef-948bc5cc69ff tempest-TestMinimumBasicScenario-381370090 tempest-TestMinimumBasicScenario-381370090-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-854569229" status: 202 len: 0 microversion: 2.1 time: 0.030852 Jul 28 01:19:07.762171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 329/687] 10.222.0.17 () {58 vars in 1269 bytes} [Thu Jul 28 01:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-854569229 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:19:08.231323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:08.231934 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:08.238574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:08.239018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:08.239780 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:08.240229 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:08.460652 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:08.469046 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc6a881b-5302-41c0-8c65-180bb2a23644 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1507 microversion: 2.1 time: 0.241599 Jul 28 01:19:08.469617 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 359/688] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:08 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:09.491236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:09.491861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:09.499365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:09.499791 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:09.500580 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:09.501003 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:09.827681 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:09.837813 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-01203bd4-7b48-47ae-a83b-73c89dc11c90 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1507 microversion: 2.1 time: 0.351260 Jul 28 01:19:09.838743 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 330/689] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:09 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:10.424056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-75c5362b-daf1-4521-9c5f-a28222f539db req-42312126-bc3b-43a0-a917-d456a984b5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f9d31b-737a-452f-b047-b6be2bea377b", "name": "network-vif-deleted", "tag": "b7d3de87-244d-4779-a3e5-9f83c3f0ed25"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:10.470283 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-75c5362b-daf1-4521-9c5f-a28222f539db req-42312126-bc3b-43a0-a917-d456a984b5c3 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:10.471130 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-75c5362b-daf1-4521-9c5f-a28222f539db req-42312126-bc3b-43a0-a917-d456a984b5c3 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:10.484281 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-75c5362b-daf1-4521-9c5f-a28222f539db req-42312126-bc3b-43a0-a917-d456a984b5c3 service nova] Creating event network-vif-deleted:b7d3de87-244d-4779-a3e5-9f83c3f0ed25 for instance 86f9d31b-737a-452f-b047-b6be2bea377b on hv-cinder-81558 Jul 28 01:19:10.491056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-75c5362b-daf1-4521-9c5f-a28222f539db req-42312126-bc3b-43a0-a917-d456a984b5c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075372 Jul 28 01:19:10.491938 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 360/690] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:10.861852 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:10.862663 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:10.870401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:10.870937 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:10.872503 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:10.873062 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:10.907471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:10.908161 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:10.908795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lazy-loading 'fault' on Instance uuid 86f9d31b-737a-452f-b047-b6be2bea377b {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:19:10.955950 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:10.964554 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6d736c51-b63b-417d-a197-2fa70a12b954 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 200 len: 1312 microversion: 2.1 time: 0.107772 Jul 28 01:19:10.980464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 331/691] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:10 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:11.986876 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:11.987434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: 86f9d31b-737a-452f-b047-b6be2bea377b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:11.993984 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:11.994440 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:11.995369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:11.995803 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:12.001463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:12.014510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] HTTP exception thrown: Instance 86f9d31b-737a-452f-b047-b6be2bea377b could not be found. Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Request method failure captured: Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b HTTP/1.1 Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLP45uroqJY4tOsw7MzTomogGWczHPDBPjWIO4CSfNcgqhyAZkGNfMAc1Lcng3yx2yG0MrSBbkOLlmT4zOZMqI_5XzYT1aMh3SmbedkYL5v7LOhTHKjqJ180qmpftqTXj8-ryE0chsIPWl-kLy3n4x47dkOY2VUMTOGAnfMLyF6vJU Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:19:12.016213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af4689d2f0ef4d71a1c465610011f2d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 018eb80709e94d5e8653fb6eeb342c54 Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 86f9d31b-737a-452f-b047-b6be2bea377b could not be found. Jul 28 01:19:12.017725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '86f9d31b-737a-452f-b047-b6be2bea377b'} Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86f9d31b-737a-452f-b047-b6be2bea377b could not be found. Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:19:12.018560 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86f9d31b-737a-452f-b047-b6be2bea377b could not be found. Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86f9d31b-737a-452f-b047-b6be2bea377b could not be found. Jul 28 01:19:12.021402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:19:12.022575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Returning 404 to user: Instance 86f9d31b-737a-452f-b047-b6be2bea377b could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:19:12.022575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f52d1d7d-9940-4c9d-bde8-40121d23ffdd tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b" status: 404 len: 111 microversion: 2.1 time: 0.035379 Jul 28 01:19:12.022575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 361/692] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:11 2022] GET /compute/v2.1/servers/86f9d31b-737a-452f-b047-b6be2bea377b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:19:12.026579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:12.027784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:12.034724 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:12.035843 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:12.036646 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:12.037107 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:12.070169 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:19:12.201636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c79091c6-3bec-4335-87ba-f85dff091bd5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 204 len: 0 microversion: 2.1 time: 0.172038 Jul 28 01:19:12.201636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 332/693] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:19:12 2022] DELETE /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:19:12.205492 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:12.206148 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:12.212796 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:12.213305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:12.214337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:12.215005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:12.367533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:12.375093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1a142757-b597-4a72-8a26-eedff63ce167 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.173476 Jul 28 01:19:12.375645 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 362/694] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:12 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:13.398151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:13.398999 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:13.406331 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:13.406880 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:13.407747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:13.408253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:13.666769 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:13.675044 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b6c4594e-f3c6-488a-83a4-ea1b0bb2732a tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.281258 Jul 28 01:19:13.675943 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 333/695] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:13 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:14.695889 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:14.696686 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:14.703788 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:14.704387 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:14.705276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:14.705818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:14.909429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:14.917120 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-05f91eb7-bdf1-4d96-a808-9a08588fcb5e tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1520 microversion: 2.1 time: 0.225239 Jul 28 01:19:14.917708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 363/696] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:14 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:15.914647 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-78efdcdf-814d-4ae7-87ad-ef2421fdd2f1 req-31c385bf-2e97-4022-a711-69bf893f5340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26acfa5-94f2-4d1d-8bfd-9f82e73861f8", "name": "network-vif-deleted", "tag": "77e6a437-69fc-4d47-b75b-cc39937c21bd"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:15.938581 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:15.939368 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:15.948815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:15.950552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-78efdcdf-814d-4ae7-87ad-ef2421fdd2f1 req-31c385bf-2e97-4022-a711-69bf893f5340 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:15.951973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:15.956056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:15.956056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:15.957114 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-78efdcdf-814d-4ae7-87ad-ef2421fdd2f1 req-31c385bf-2e97-4022-a711-69bf893f5340 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:15.981170 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-78efdcdf-814d-4ae7-87ad-ef2421fdd2f1 req-31c385bf-2e97-4022-a711-69bf893f5340 service nova] Creating event network-vif-deleted:77e6a437-69fc-4d47-b75b-cc39937c21bd for instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 on hv-cinder-81558 Jul 28 01:19:15.987738 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-78efdcdf-814d-4ae7-87ad-ef2421fdd2f1 req-31c385bf-2e97-4022-a711-69bf893f5340 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079427 Jul 28 01:19:15.992224 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 334/697] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:19:16.065286 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018eb80709e94d5e8653fb6eeb342c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4689d2f0ef4d71a1c465610011f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:16.091098 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-408b5fd3-fc24-4f95-b85c-dc01d7099da5 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 200 len: 1306 microversion: 2.1 time: 0.156408 Jul 28 01:19:16.092059 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 364/698] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:15 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:17.114250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:17.115207 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] [instance: e26acfa5-94f2-4d1d-8bfd-9f82e73861f8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:17.122629 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:17.123121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:17.124069 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:17.124660 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:17.149418 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] HTTP exception thrown: Instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 could not be found. Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Request method failure captured: Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 HTTP/1.1 Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLP45uroqJY4tOsw7MzTomogGWczHPDBPjWIO4CSfNcgqhyAZkGNfMAc1Lcng3yx2yG0MrSBbkOLlmT4zOZMqI_5XzYT1aMh3SmbedkYL5v7LOhTHKjqJ180qmpftqTXj8-ryE0chsIPWl-kLy3n4x47dkOY2VUMTOGAnfMLyF6vJU Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:19:17.152438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af4689d2f0ef4d71a1c465610011f2d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af4689d2f0ef4d71a1c465610011f2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: af4689d2f0ef4d71a1c465610011f2d7 Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-335528480 Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 018eb80709e94d5e8653fb6eeb342c54 Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-335528480-project Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 could not be found. Jul 28 01:19:17.154007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'e26acfa5-94f2-4d1d-8bfd-9f82e73861f8'} Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 could not be found. Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:19:17.154848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 could not be found. Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 could not be found. Jul 28 01:19:17.156270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:17.157861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] Returning 404 to user: Instance e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:19:17.157861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b0b2c12d-c78c-4857-b1f7-46bafff6d834 tempest-ServerRescueNegativeTestJSON-335528480 tempest-ServerRescueNegativeTestJSON-335528480-project] 10.222.0.17 "GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8" status: 404 len: 111 microversion: 2.1 time: 0.045083 Jul 28 01:19:17.157861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 335/699] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:17 2022] GET /compute/v2.1/servers/e26acfa5-94f2-4d1d-8bfd-9f82e73861f8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:19:23.213692 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:23.214298 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:23.223482 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:23.224088 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:23.224936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:23.225638 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:23.252125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:19:23.333691 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2aca2a6e-31b2-40b2-a782-286a92377c92 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 204 len: 0 microversion: 2.1 time: 0.125707 Jul 28 01:19:23.334580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 365/700] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:19:23 2022] DELETE /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:19:23.343102 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:23.343711 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:23.345790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:23.351094 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:23.351536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:23.352290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:23.352717 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:23.499409 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:23.512566 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d0bdb09b-c220-48b3-a70c-44ba17cc64d3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1577 microversion: 2.1 time: 0.173091 Jul 28 01:19:23.513243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 336/701] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:23 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:24.536959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:24.537635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:24.547170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:24.548256 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:24.549382 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:24.550374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:24.688655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:24.696358 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af80d814-0315-4051-bcf2-20ed83e9dfc4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1577 microversion: 2.1 time: 0.165696 Jul 28 01:19:24.696932 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 366/702] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:24 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:25.716818 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:25.717454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:25.724635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:25.725024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:25.725806 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:25.726328 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:25.843618 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-86831be5-81a8-4342-897b-10ef13ca664e req-498d4dd7-e186-4de9-b5ff-3dc54ca94bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aad030-b12c-409b-b5da-ba6eb7779f32", "name": "network-vif-deleted", "tag": "1e3d4ead-cc70-43f5-a886-471d0c3f9868"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:25.849916 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:25.857348 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:25.863128 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-86831be5-81a8-4342-897b-10ef13ca664e req-498d4dd7-e186-4de9-b5ff-3dc54ca94bd6 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:25.863948 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-86831be5-81a8-4342-897b-10ef13ca664e req-498d4dd7-e186-4de9-b5ff-3dc54ca94bd6 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:25.872526 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-69b1033c-a0b1-45aa-96b1-cace5f4a95d4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 200 len: 1509 microversion: 2.1 time: 0.159378 Jul 28 01:19:25.873726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 337/703] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:25 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:25.913505 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-86831be5-81a8-4342-897b-10ef13ca664e req-498d4dd7-e186-4de9-b5ff-3dc54ca94bd6 service nova] Creating event network-vif-deleted:1e3d4ead-cc70-43f5-a886-471d0c3f9868 for instance 49aad030-b12c-409b-b5da-ba6eb7779f32 on hv-cinder-81558 Jul 28 01:19:25.928429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-86831be5-81a8-4342-897b-10ef13ca664e req-498d4dd7-e186-4de9-b5ff-3dc54ca94bd6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088558 Jul 28 01:19:25.930008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 367/704] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:19:26.894223 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:26.895616 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:26.903563 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:26.904247 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:26.905353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:26.906157 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:26.921346 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] HTTP exception thrown: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Request method failure captured: Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 HTTP/1.1 Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eMtzwkLQ1rn8Dl0B5zAdjHygkUVQIiH_HqnSND2HI2d_H3NWBEQbksnaf8BpyAi5f0I3dl2XB7fON2r93CnLE4sr-2ry9R5B_aR040dut_inZWj2hJjojyTLVxoRn7XhLFeWwR8Swh9hMlN5GCdpV1Fish2N5v0cyUITcLBDXJ9eeU Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:19:26.923273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d14de33f76ea44db8899900481299b87", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d14de33f76ea44db8899900481299b87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-TestVolumeBootPattern-455249764 Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: d9cb42db2f9a4b80b17bef0a86945a6c Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:19:26.924679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '49aad030-b12c-409b-b5da-ba6eb7779f32'} Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:19:26.925735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:19:26.927909 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:19:26.931143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Returning 404 to user: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:19:26.932232 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c0f69444-773c-49e2-9191-248bfcc2f290 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 404 len: 111 microversion: 2.1 time: 0.042220 Jul 28 01:19:26.942669 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 338/705] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:26 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:19:27.052991 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1411442766", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-388651129", "security_groups": [{"name": "tempest-secgroup-smoke-1741610070"}], "block_device_mapping_v2": [{"uuid": "0fe0bd15-81ee-4791-b0a4-bab97182091d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f365ac42-75a7-4c3d-8591-d4097c9f6065"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:27.174762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] validate_networks() for [('f365ac42-75a7-4c3d-8591-d4097c9f6065', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:19:27.737586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:19:27.738096 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:19:27.738642 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:19:27.739143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:19:27.739629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:19:27.748775 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:27.749218 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:27.750015 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:27.750446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:27.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for project d14de33f76ea44db8899900481299b87. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:19:27.772402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for user d9cb42db2f9a4b80b17bef0a86945a6c and project d14de33f76ea44db8899900481299b87. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:19:27.835679 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:19:27.837888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fe0bd15-81ee-4791-b0a4-bab97182091d',volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:19:27.976944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-904c1d9a-8f0d-4863-b50b-01d799c99adf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.925951 Jul 28 01:19:27.976944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 368/706] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:19:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:19:27.990938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-517e88eb-f3a8-43fc-929d-90da78af40c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:27.992592 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-517e88eb-f3a8-43fc-929d-90da78af40c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:28.057881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-517e88eb-f3a8-43fc-929d-90da78af40c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:28.066196 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-517e88eb-f3a8-43fc-929d-90da78af40c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1094 microversion: 2.1 time: 0.081403 Jul 28 01:19:28.067574 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 339/707] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:27 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:29.088082 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:29.089960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:29.098154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:29.098736 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:29.100464 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:29.100904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:29.198202 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:29.207945 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-67cab11c-f83d-4f71-9c3e-44fe360ecbce tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1210 microversion: 2.1 time: 0.123697 Jul 28 01:19:29.208510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 369/708] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:29 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:30.229319 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:30.230000 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:30.240895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:30.241340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:30.242113 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:30.242542 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:30.454949 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:30.462692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-66405e7c-21d0-4b10-8e8e-572b22306045 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.237272 Jul 28 01:19:30.463329 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 340/709] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:30 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:30.621281 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-1730ac29-ace0-4356-a78d-6afd6ce0bcf3 req-b16c50fe-f79e-4621-9b42-9151f33645f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef8c75-a39b-4af4-813b-7d195164631d", "tag": "5e443d88-263d-417b-a4b5-1c7b5ec04947"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:30.637350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1730ac29-ace0-4356-a78d-6afd6ce0bcf3 req-b16c50fe-f79e-4621-9b42-9151f33645f6 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:30.638135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1730ac29-ace0-4356-a78d-6afd6ce0bcf3 req-b16c50fe-f79e-4621-9b42-9151f33645f6 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:30.651983 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-1730ac29-ace0-4356-a78d-6afd6ce0bcf3 req-b16c50fe-f79e-4621-9b42-9151f33645f6 service nova] Creating event network-changed:5e443d88-263d-417b-a4b5-1c7b5ec04947 for instance 3aef8c75-a39b-4af4-813b-7d195164631d on hv-cinder-81558 Jul 28 01:19:30.657071 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-1730ac29-ace0-4356-a78d-6afd6ce0bcf3 req-b16c50fe-f79e-4621-9b42-9151f33645f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040817 Jul 28 01:19:30.660920 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 370/710] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:31.484034 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:31.484670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:31.491803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:31.492256 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:31.493055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:31.493466 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:31.637463 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:31.646028 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3ef8e77b-3c52-4c4d-b070-60163df2b392 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.165918 Jul 28 01:19:31.646597 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 341/711] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:31 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:32.671134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:32.671743 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:32.678576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:32.679061 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:32.679845 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:32.680278 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:32.824913 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:32.832633 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f2d6251c-106b-4361-b7ab-d630aff9af17 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.168024 Jul 28 01:19:32.833347 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 371/712] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:32 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:33.856590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:33.857392 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:33.864426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:33.864881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:33.865666 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:33.866101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:34.052640 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:34.063664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-62a3c5bc-af3f-44ae-9ebc-f5b6cead0b68 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.213517 Jul 28 01:19:34.064271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 342/713] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:33 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:34.881260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f592dc98-e36f-4179-a8a9-adf6101e7461 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:34.881773 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f592dc98-e36f-4179-a8a9-adf6101e7461 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:34.888269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f592dc98-e36f-4179-a8a9-adf6101e7461 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:34.888832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f592dc98-e36f-4179-a8a9-adf6101e7461 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:34.889610 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f592dc98-e36f-4179-a8a9-adf6101e7461 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:34.890047 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f592dc98-e36f-4179-a8a9-adf6101e7461 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:34.912785 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f592dc98-e36f-4179-a8a9-adf6101e7461 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/ips" status: 200 len: 152 microversion: 2.20 time: 0.216933 Jul 28 01:19:34.913315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 372/714] 10.222.0.17 () {60 vars in 1289 bytes} [Thu Jul 28 01:19:34 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/ips => generated 152 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:19:35.088155 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:35.088777 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:35.096814 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:35.097537 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:35.098601 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:35.099145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:35.260304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:35.270994 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-02cbed88-7f51-45e3-8206-b87415b935c9 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.186172 Jul 28 01:19:35.271812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 343/715] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:35 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:36.293345 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:36.294263 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:36.301669 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:36.302112 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:36.302892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:36.303324 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:36.455011 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:36.462814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8607d029-3620-45b8-88a6-602e4747b2a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.173856 Jul 28 01:19:36.463604 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 373/716] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:36 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:36.751996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:36.752562 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:36.760893 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:36.761347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:36.762122 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:36.762556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:36.766261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:36.786439 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lazy-loading 'flavor' on Instance uuid b035e590-ae9f-4fb3-ac7f-3615a1ce992c {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:19:36.969451 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1aadd656-cf78-4165-b050-b8536dc738db tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/action" status: 202 len: 0 microversion: 2.20 time: 0.225600 Jul 28 01:19:36.970136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 344/717] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Jul 28 01:19:36 2022] POST /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:19:36.978495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:36.979158 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:36.985470 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:36.986021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:36.986792 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:36.987279 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:37.142926 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:37.152092 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:37.153715 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:37.155068 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9be67398-4709-4975-96ff-c19694156f1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.180457 Jul 28 01:19:37.155678 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 374/718] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:36 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:37.484916 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:37.485626 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:37.492783 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:37.493227 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:37.493996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:37.494433 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:37.637175 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:37.645307 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-facf9d48-e09e-4bd6-9819-20062abfbe7c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.164704 Jul 28 01:19:37.645891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 345/719] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:37 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:38.179260 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:38.180075 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:38.182347 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:38.183233 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:38.190681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:38.191223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:38.192078 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:38.192569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:38.364888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:38.374779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:38.376315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:38.377524 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1eddb086-e2df-4f45-8afd-9de09316e750 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.202360 Jul 28 01:19:38.378113 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 375/720] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:38 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:38.668102 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:38.669304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:38.672113 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:38.678176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:38.678745 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:38.679557 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:38.679993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:38.821760 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:38.829711 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1a8e4c3e-19d1-485b-bab7-8666e1fe1c44 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.165969 Jul 28 01:19:38.830286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 346/721] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:38 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:39.401985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:39.402784 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:39.409442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:39.409932 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:39.410725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:39.411355 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:39.553204 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:39.563086 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:39.563086 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:39.564394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2741ba09-dc17-4909-92ee-f039cdfd6e49 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.167169 Jul 28 01:19:39.565003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 376/722] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:39 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:39.853299 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:39.854146 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:39.863883 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:39.864345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:39.865092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:39.865502 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:40.004704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:40.014400 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-16c3aeab-a9b0-4525-aad1-632ce251ea18 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.165876 Jul 28 01:19:40.014400 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 347/723] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:39 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:40.587746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:40.588462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:40.595232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:40.596187 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:40.596491 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:40.597128 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:40.732964 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:40.741458 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:40.743056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:40.744222 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f60b3c16-5b88-47ab-a0df-71dc3f458878 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.160407 Jul 28 01:19:40.744790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 377/724] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:40 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:41.036063 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:41.036632 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:41.043527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:41.044006 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:41.044764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:41.045196 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:41.194887 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:41.206403 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dc96855f-e7ad-4b74-92fc-c7a263a09e0e tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.174079 Jul 28 01:19:41.207178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 348/725] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:41 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:41.768636 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:41.769296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:41.775462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:41.775933 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:41.776733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:41.777158 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:41.915175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:41.923195 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:41.924831 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:41.926210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-970ab110-7435-4052-b062-e743e1145a22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.161937 Jul 28 01:19:41.926963 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 378/726] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:41 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:42.232628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:42.233256 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:42.240118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:42.240565 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:42.241343 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:42.241776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:42.383692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:42.391807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e620544a-b3d9-4c81-9b92-1c3a3ced3c5f tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.163156 Jul 28 01:19:42.392375 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 349/727] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:42 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:42.955514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:42.956085 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:42.962965 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:42.963420 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:42.964200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:42.964630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:42.967295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:43.109072 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:43.117921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:43.119458 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:43.120638 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8e1bce1-1240-4091-80ca-18995e65980a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.171541 Jul 28 01:19:43.121228 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 379/728] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:42 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:43.417710 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:43.418354 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:43.427334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:43.428202 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:43.429138 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:43.429744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:43.583052 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:43.592212 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d53fc627-aafb-4808-97f2-c4d30f86a586 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.178489 Jul 28 01:19:43.592803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 350/729] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:43 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:44.031785 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-8ee069c6-5e75-4671-9afa-9f7e7c344b9e req-7ab34595-793b-4119-9f77-50472767681d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef8c75-a39b-4af4-813b-7d195164631d", "name": "network-vif-plugged", "status": "completed", "tag": "5e443d88-263d-417b-a4b5-1c7b5ec04947"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:44.041374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-8ee069c6-5e75-4671-9afa-9f7e7c344b9e req-7ab34595-793b-4119-9f77-50472767681d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:44.041818 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-8ee069c6-5e75-4671-9afa-9f7e7c344b9e req-7ab34595-793b-4119-9f77-50472767681d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:44.053198 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-8ee069c6-5e75-4671-9afa-9f7e7c344b9e req-7ab34595-793b-4119-9f77-50472767681d service nova] Creating event network-vif-plugged:5e443d88-263d-417b-a4b5-1c7b5ec04947 for instance 3aef8c75-a39b-4af4-813b-7d195164631d on hv-cinder-81558 Jul 28 01:19:44.059461 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-8ee069c6-5e75-4671-9afa-9f7e7c344b9e req-7ab34595-793b-4119-9f77-50472767681d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238639 Jul 28 01:19:44.060795 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 380/730] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:44.148086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:44.148770 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:44.155043 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:44.155492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:44.156268 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:44.156845 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:44.430264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:44.438702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:44.440487 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:44.441651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1898a281-f96a-4df6-95e1-eafda5135865 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.297565 Jul 28 01:19:44.452409 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 351/731] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:44 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:44.614363 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:44.615093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:44.621280 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:44.621741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:44.622506 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:44.622976 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:44.762095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:44.769733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9c118170-e047-4bcd-88c7-fdc4c95e7edf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1266 microversion: 2.1 time: 0.159776 Jul 28 01:19:44.770318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 381/732] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:44 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:45.464817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:45.465394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:45.472452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:45.473268 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:45.474125 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:45.474826 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:45.613753 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:45.623733 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:45.626083 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:45.627377 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-108c9cd8-73a0-448f-acf7-a37910c5a6dd tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.166421 Jul 28 01:19:45.627917 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 352/733] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:45 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:45.789757 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:45.791040 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:45.799491 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:45.800012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:45.800802 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:45.801243 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:45.944402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:45.954708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-99464251-330c-4378-84be-bc1ef6156155 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1453 microversion: 2.1 time: 0.168639 Jul 28 01:19:45.955519 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 382/734] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:45 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:45.975007 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:45.975621 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:45.981794 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:45.982242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:45.983070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:45.983516 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:46.123277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:46.131504 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5786cd64-41ad-4cf3-bfb6-c4959b1544d6 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1453 microversion: 2.1 time: 0.160341 Jul 28 01:19:46.132077 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 353/735] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:45 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:46.652306 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:46.652777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:46.659630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:46.659989 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:46.660750 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:46.661172 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:46.903490 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:46.912463 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:46.914351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:46.915524 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-55ee9081-f495-44de-a81b-4bd4ce366349 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.267280 Jul 28 01:19:46.916188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 383/736] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:46 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:47.921093 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-422fe240-3730-4d47-a244-350d51d63a05 req-4f41f354-b46d-4943-bd50-4f71b2d7af9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef8c75-a39b-4af4-813b-7d195164631d", "tag": "5e443d88-263d-417b-a4b5-1c7b5ec04947"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:47.931698 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-422fe240-3730-4d47-a244-350d51d63a05 req-4f41f354-b46d-4943-bd50-4f71b2d7af9a service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:47.932233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-422fe240-3730-4d47-a244-350d51d63a05 req-4f41f354-b46d-4943-bd50-4f71b2d7af9a service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:47.940529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:47.941137 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:47.944083 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-422fe240-3730-4d47-a244-350d51d63a05 req-4f41f354-b46d-4943-bd50-4f71b2d7af9a service nova] Creating event network-changed:5e443d88-263d-417b-a4b5-1c7b5ec04947 for instance 3aef8c75-a39b-4af4-813b-7d195164631d on hv-cinder-81558 Jul 28 01:19:47.948307 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:47.949106 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:47.949958 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:47.950508 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:47.951028 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-422fe240-3730-4d47-a244-350d51d63a05 req-4f41f354-b46d-4943-bd50-4f71b2d7af9a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034442 Jul 28 01:19:47.951726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 354/737] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:48.186014 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:48.195416 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:48.197017 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:48.198332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4a64c67b-4f37-421a-9ce8-aa8ce582bafb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.261784 Jul 28 01:19:48.199014 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 384/738] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:47 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:49.223924 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:49.225760 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:49.233718 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:49.234163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:49.234997 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:49.235426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:49.388050 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:49.396901 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:49.398657 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:49.399884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-99608c8b-0815-48b1-8f8a-63d341514020 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.181945 Jul 28 01:19:49.400454 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 355/739] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:49 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:50.423945 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:50.424545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:50.430739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:50.431235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:50.432020 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:50.432461 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:50.463118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7c78aa16-6d31-4f3c-b61e-ac436b042ae9 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:50.463706 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7c78aa16-6d31-4f3c-b61e-ac436b042ae9 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:50.472915 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c78aa16-6d31-4f3c-b61e-ac436b042ae9 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:50.473641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c78aa16-6d31-4f3c-b61e-ac436b042ae9 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:50.474615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c78aa16-6d31-4f3c-b61e-ac436b042ae9 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:50.475240 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c78aa16-6d31-4f3c-b61e-ac436b042ae9 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:50.503427 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7c78aa16-6d31-4f3c-b61e-ac436b042ae9 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/ips" status: 200 len: 144 microversion: 2.1 time: 0.044801 Jul 28 01:19:50.504661 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 356/740] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:19:50 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:19:50.593645 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:50.603024 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:50.605187 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:50.606728 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d50ffb1e-5cc3-483e-a33b-399ca5d409a6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.186801 Jul 28 01:19:50.607782 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 385/741] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:50 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:51.634911 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:51.635599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:51.642744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:51.643284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:51.644122 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:51.644620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:51.781287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:51.789766 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:51.791286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:51.792455 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a838fb86-e0e5-44ce-8c09-a3ad3fd9234e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.161759 Jul 28 01:19:51.793026 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 357/742] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:51 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:51.867225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c195ba60-640d-4a08-a265-b821018cea5a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7adcae5-e1b5-4fc2-9351-cf358cf61169"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:51.869729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c195ba60-640d-4a08-a265-b821018cea5a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:51.875832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c195ba60-640d-4a08-a265-b821018cea5a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:51.876283 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c195ba60-640d-4a08-a265-b821018cea5a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:51.877079 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c195ba60-640d-4a08-a265-b821018cea5a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:51.877514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c195ba60-640d-4a08-a265-b821018cea5a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:52.261378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c195ba60-640d-4a08-a265-b821018cea5a tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398147 Jul 28 01:19:52.262006 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 386/743] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:19:51 2022] POST /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:52.815770 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:52.816380 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:52.823394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:52.823837 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:52.824625 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:52.825107 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:52.957767 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:52.965874 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:52.967441 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:52.969069 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-da32b79d-0441-4482-98af-1ca984869e3c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1744 microversion: 2.20 time: 0.157345 Jul 28 01:19:52.977590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 358/744] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:52 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:53.995411 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:53.996109 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:54.002934 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:54.003386 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:54.004139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:54.004561 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:54.159833 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:54.168233 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:54.169807 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:54.171033 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2f8e10c-ce90-4543-974d-000bb3ca74c2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1744 microversion: 2.20 time: 0.181333 Jul 28 01:19:54.171608 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 387/745] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:53 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:55.195637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:55.196841 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:55.206054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=48 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:55.209429 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:55.210123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:55.216308 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:55.217159 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:55.382173 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:55.384428 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:55.397069 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:55.399162 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:55.412288 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-605c2559-261c-494f-ac4d-2bd4a785ac22 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.222298 Jul 28 01:19:55.412892 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 359/746] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:55 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:55.963354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-23dc2520-fc33-4c49-924c-8f0422def00e req-3cc3c9bc-bba9-42c2-83d5-3e85904d360b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035e590-ae9f-4fb3-ac7f-3615a1ce992c", "name": "network-vif-plugged", "status": "completed", "tag": "bd4676aa-4815-4dd2-8cfe-5bab28819f71"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:55.980825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-23dc2520-fc33-4c49-924c-8f0422def00e req-3cc3c9bc-bba9-42c2-83d5-3e85904d360b service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:55.981609 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-23dc2520-fc33-4c49-924c-8f0422def00e req-3cc3c9bc-bba9-42c2-83d5-3e85904d360b service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:55.996122 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-23dc2520-fc33-4c49-924c-8f0422def00e req-3cc3c9bc-bba9-42c2-83d5-3e85904d360b service nova] Creating event network-vif-plugged:bd4676aa-4815-4dd2-8cfe-5bab28819f71 for instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c on hv-cinder-81558 Jul 28 01:19:56.007170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-23dc2520-fc33-4c49-924c-8f0422def00e req-3cc3c9bc-bba9-42c2-83d5-3e85904d360b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044853 Jul 28 01:19:56.008394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 388/747] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:19:56.435335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:56.436567 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:56.446579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:56.447304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:56.448279 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:56.448870 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:56.609867 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:56.618876 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:56.620399 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:56.621758 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b978ca1d-857e-4771-8110-d600ee35a14e tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.190226 Jul 28 01:19:56.622616 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 360/748] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:56 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:56.868809 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-502322477", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "networks": [{"uuid": "0631c6f7-c6a9-43dd-81e8-03129aee137b"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:19:56.924792 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] validate_networks() for [('0631c6f7-c6a9-43dd-81e8-03129aee137b', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:19:57.595229 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:19:57.595921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:19:57.596284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:19:57.596693 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:19:57.597243 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:19:57.599960 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:19:57.609989 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:57.610763 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:57.611805 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:57.612413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:57.633205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Getting quotas for project 8840b41dd8364a8a976f04d4fe421b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:19:57.638035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Getting quotas for user 82a7db7a0f544b3eb9487bf00adbb742 and project 8840b41dd8364a8a976f04d4fe421b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:19:57.646093 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:57.646862 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:57.651892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:19:57.654681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:19:57.654965 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:57.655527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:57.656411 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:57.657043 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:57.722135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b2155764-cd97-4a9e-8159-0833f1e32546 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857299 Jul 28 01:19:57.723494 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 389/749] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:19:57.735388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f68885d3-494e-4302-80a4-9c34a40b8ab4 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:57.736527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f68885d3-494e-4302-80a4-9c34a40b8ab4 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:57.825933 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f68885d3-494e-4302-80a4-9c34a40b8ab4 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:57.855557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f68885d3-494e-4302-80a4-9c34a40b8ab4 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1218 microversion: 2.1 time: 0.121809 Jul 28 01:19:57.859580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 390/750] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:57 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:57.882248 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:57.891923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:57.893735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:57.894948 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-79b8165a-52f7-4c29-8d57-ca41e49a0f01 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.253511 Jul 28 01:19:57.895520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 361/751] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:57 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:58.894068 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:58.895816 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:58.914211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:58.914680 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:58.915824 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:58.916447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:58.919666 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:58.921371 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:58.933920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:58.934645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:58.935731 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:58.936286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:58.996705 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:59.009383 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-385cba12-7b5e-46aa-92d6-96f639986fe0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1270 microversion: 2.1 time: 0.122046 Jul 28 01:19:59.009640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 391/752] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:19:58 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:19:59.117011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:59.126019 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:59.127890 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:19:59.129058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-62e09c39-8f35-4426-822e-4ae763f1e165 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.214165 Jul 28 01:19:59.129630 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 362/753] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:19:58 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:19:59.952464 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a6e2ab83-aa94-4818-81aa-024f869d78d8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:19:59.955545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a6e2ab83-aa94-4818-81aa-024f869d78d8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:19:59.963099 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6e2ab83-aa94-4818-81aa-024f869d78d8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:59.963716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6e2ab83-aa94-4818-81aa-024f869d78d8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:19:59.965934 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6e2ab83-aa94-4818-81aa-024f869d78d8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:19:59.966731 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6e2ab83-aa94-4818-81aa-024f869d78d8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:00.004239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a6e2ab83-aa94-4818-81aa-024f869d78d8 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064084 Jul 28 01:20:00.005978 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 392/754] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:19:59 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:00.016747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2e6832ba-ac58-4432-a19a-eb8c99d450ed tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:00.017896 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2e6832ba-ac58-4432-a19a-eb8c99d450ed tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:00.026221 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2e6832ba-ac58-4432-a19a-eb8c99d450ed tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:00.026702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2e6832ba-ac58-4432-a19a-eb8c99d450ed tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:00.027571 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2e6832ba-ac58-4432-a19a-eb8c99d450ed tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:00.028052 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2e6832ba-ac58-4432-a19a-eb8c99d450ed tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:00.029744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:00.030527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:00.036797 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:00.037370 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:00.038248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:00.038784 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:00.068322 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2e6832ba-ac58-4432-a19a-eb8c99d450ed tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/b7adcae5-e1b5-4fc2-9351-cf358cf61169" status: 200 len: 194 microversion: 2.1 time: 0.055745 Jul 28 01:20:00.075687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 363/755] 10.222.0.17 () {58 vars in 1413 bytes} [Thu Jul 28 01:20:00 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/b7adcae5-e1b5-4fc2-9351-cf358cf61169 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:00.154033 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:00.155203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:00.164859 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:00.165628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:00.166604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:00.167503 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:00.457396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:00.468665 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-97baf292-59b1-45ec-8294-18e401986f1f tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.442067 Jul 28 01:20:00.469269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 393/756] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:00 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:20:00.671237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:00.682678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:00.684417 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:00.685713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4978ab71-67ab-4791-81cd-45b29c2b2ddb tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.537048 Jul 28 01:20:00.686898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 364/757] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:00 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:20:01.078360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-1fcbaee7-dbd0-478f-9860-0b08576a73f0 req-b5b90447-688b-44d8-bb37-0af8a74a6578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d171e509-4b0b-4f14-beeb-9aebd8589468", "tag": "0cdf79c7-1022-469b-bd0d-5cb24728ad29"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:01.091430 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1fcbaee7-dbd0-478f-9860-0b08576a73f0 req-b5b90447-688b-44d8-bb37-0af8a74a6578 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:01.092264 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1fcbaee7-dbd0-478f-9860-0b08576a73f0 req-b5b90447-688b-44d8-bb37-0af8a74a6578 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:01.110595 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-1fcbaee7-dbd0-478f-9860-0b08576a73f0 req-b5b90447-688b-44d8-bb37-0af8a74a6578 service nova] Creating event network-changed:0cdf79c7-1022-469b-bd0d-5cb24728ad29 for instance d171e509-4b0b-4f14-beeb-9aebd8589468 on hv-cinder-81558 Jul 28 01:20:01.116210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-1fcbaee7-dbd0-478f-9860-0b08576a73f0 req-b5b90447-688b-44d8-bb37-0af8a74a6578 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043157 Jul 28 01:20:01.116814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 394/758] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:01.491895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:01.493319 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:01.500313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:01.501099 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:01.502166 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:01.502791 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:01.576646 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7409b81c-f12c-4423-aac2-c3328b09f65b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80757411-b942-4f50-a54d-4df8a990fdb2"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:01.579564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7409b81c-f12c-4423-aac2-c3328b09f65b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:01.586967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7409b81c-f12c-4423-aac2-c3328b09f65b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:01.587806 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7409b81c-f12c-4423-aac2-c3328b09f65b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:01.588810 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7409b81c-f12c-4423-aac2-c3328b09f65b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:01.589458 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7409b81c-f12c-4423-aac2-c3328b09f65b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:01.688427 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:01.696395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0f7af900-0cef-4201-9bc6-f448b4413829 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.210377 Jul 28 01:20:01.696964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 365/759] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:01 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:01.714563 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:01.715287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:01.722348 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:01.723127 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:01.724067 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:01.724670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:01.865984 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:01.874432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:01.875938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:01.877564 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-eb17fc1c-e1f7-46ff-9e32-7c83666e83e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.166960 Jul 28 01:20:01.893328 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 366/760] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:01 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:02.644637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7409b81c-f12c-4423-aac2-c3328b09f65b tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "POST /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.072781 Jul 28 01:20:02.652708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 395/761] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:20:01 2022] POST /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:20:02.717552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:02.718246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:02.739615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:02.740919 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:02.742017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:02.742662 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:02.901379 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:02.902084 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:02.911695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:02.912448 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:02.913370 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:02.913971 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:03.045260 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:03.053117 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3b54f543-3593-4b32-b4cb-21deab000988 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.339762 Jul 28 01:20:03.054313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 367/762] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:02 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:03.184115 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:03.191009 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:03.211375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:03.216199 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:03.219012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-712a02b3-ac42-4323-9bf4-99cd183751d9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.321870 Jul 28 01:20:03.225241 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 396/763] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:02 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:20:04.074094 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:04.074777 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:04.082262 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:04.082801 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:04.083663 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:04.084162 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:04.233993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:04.243004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ad30da98-0cff-4cc4-856a-f0367ab70be2 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.172934 Jul 28 01:20:04.255137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 368/764] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:04 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:04.259839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:04.261034 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:04.268318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:04.268772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:04.269547 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:04.269974 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:04.453429 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:04.461941 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:04.464715 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:04.465315 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9340e136-58ce-49eb-8c29-7f52b773f902 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1739 microversion: 2.20 time: 0.223668 Jul 28 01:20:04.466220 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 397/765] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:04 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:05.268654 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:05.269305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:05.276277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:05.276847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:05.277702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:05.278130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:05.488964 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:05.489570 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:05.496568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:05.496998 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:05.497848 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:05.498280 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:05.502855 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:05.510710 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0537f353-7eec-47d6-b007-f0a186456c08 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.246211 Jul 28 01:20:05.511431 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 369/766] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:05 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:05.731207 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:05.741779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:05.744144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:05.745929 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bd871014-4500-49ea-8301-afc1de1fc30d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1721 microversion: 2.20 time: 0.260959 Jul 28 01:20:05.746719 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 398/767] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:05 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:05.961360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-34bf52ad-0d83-4d82-a92a-2acf49ae3016 req-925099e6-ea81-4f50-9463-9e915769207a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d171e509-4b0b-4f14-beeb-9aebd8589468", "name": "network-vif-plugged", "status": "completed", "tag": "0cdf79c7-1022-469b-bd0d-5cb24728ad29"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:05.972103 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-34bf52ad-0d83-4d82-a92a-2acf49ae3016 req-925099e6-ea81-4f50-9463-9e915769207a service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:05.972633 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-34bf52ad-0d83-4d82-a92a-2acf49ae3016 req-925099e6-ea81-4f50-9463-9e915769207a service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:05.987188 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-34bf52ad-0d83-4d82-a92a-2acf49ae3016 req-925099e6-ea81-4f50-9463-9e915769207a service nova] Creating event network-vif-plugged:0cdf79c7-1022-469b-bd0d-5cb24728ad29 for instance d171e509-4b0b-4f14-beeb-9aebd8589468 on hv-cinder-81558 Jul 28 01:20:05.992457 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-34bf52ad-0d83-4d82-a92a-2acf49ae3016 req-925099e6-ea81-4f50-9463-9e915769207a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 Jul 28 01:20:05.993248 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 370/768] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:06.534961 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:06.535563 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:06.542304 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:06.542744 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:06.543528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:06.543951 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:06.690058 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:06.698120 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-33cf044e-ddbb-4323-bcc6-433759c42b5a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.168640 Jul 28 01:20:06.698666 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 399/769] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:06 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:06.778282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:06.779163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:06.786694 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:06.787318 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:06.788320 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:06.788888 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:06.932637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:06.940801 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:06.942248 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:06.943453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3fff7e8e-1d0e-4727-bf68-0c0a77850b0f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1721 microversion: 2.20 time: 0.169993 Jul 28 01:20:06.944008 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 371/770] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:06 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:07.720634 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:07.721217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:07.723588 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:07.729675 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:07.730077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:07.730869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:07.731319 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:07.832643 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=8 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:07.872291 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:07.880568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b29eb206-7dca-4e6b-a9c0-f71ef856f3e6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.163640 Jul 28 01:20:07.881155 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 400/771] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:07 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:07.967139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:07.967758 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:07.974524 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:07.975360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:07.976185 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:07.976872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.012796 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-cd93a340-065f-490f-9500-152bb54cfaf5 req-0fdb660e-7817-4f72-aad5-aa81e20486df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035e590-ae9f-4fb3-ac7f-3615a1ce992c", "name": "network-vif-unplugged", "status": "completed", "tag": "bd4676aa-4815-4dd2-8cfe-5bab28819f71"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:08.022609 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-cd93a340-065f-490f-9500-152bb54cfaf5 req-0fdb660e-7817-4f72-aad5-aa81e20486df service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.023086 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-cd93a340-065f-490f-9500-152bb54cfaf5 req-0fdb660e-7817-4f72-aad5-aa81e20486df service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.034861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-cd93a340-065f-490f-9500-152bb54cfaf5 req-0fdb660e-7817-4f72-aad5-aa81e20486df service nova] Creating event network-vif-unplugged:bd4676aa-4815-4dd2-8cfe-5bab28819f71 for instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c on hv-cinder-81558 Jul 28 01:20:08.040114 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-cd93a340-065f-490f-9500-152bb54cfaf5 req-0fdb660e-7817-4f72-aad5-aa81e20486df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030998 Jul 28 01:20:08.041011 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 401/772] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:08.140521 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:08.148993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:08.150520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:08.151969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0ca6ac06-77c6-4f86-86d5-af875970db9d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1724 microversion: 2.20 time: 0.188846 Jul 28 01:20:08.152543 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 372/773] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:07 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:08.175276 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12d1ea47-2990-472d-af1a-9c9d04cb429b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92cf8f8f-7182-44ab-9fb5-8c9ae5b09db3"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:08.177845 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12d1ea47-2990-472d-af1a-9c9d04cb429b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:08.184613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d1ea47-2990-472d-af1a-9c9d04cb429b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.185060 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d1ea47-2990-472d-af1a-9c9d04cb429b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.185846 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d1ea47-2990-472d-af1a-9c9d04cb429b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.186281 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d1ea47-2990-472d-af1a-9c9d04cb429b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.478272 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-12d1ea47-2990-472d-af1a-9c9d04cb429b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307333 Jul 28 01:20:08.479301 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 402/774] 10.222.0.17 () {62 vars in 1364 bytes} [Thu Jul 28 01:20:08 2022] POST /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 01:20:08.618396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a82bffdb-8e86-45c9-8659-8bbcb291458b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:08.618917 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a82bffdb-8e86-45c9-8659-8bbcb291458b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:08.625144 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a82bffdb-8e86-45c9-8659-8bbcb291458b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.625583 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a82bffdb-8e86-45c9-8659-8bbcb291458b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.628926 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a82bffdb-8e86-45c9-8659-8bbcb291458b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.628926 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a82bffdb-8e86-45c9-8659-8bbcb291458b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.877070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a82bffdb-8e86-45c9-8659-8bbcb291458b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-volume_attachments/92cf8f8f-7182-44ab-9fb5-8c9ae5b09db3" status: 202 len: 0 microversion: 2.20 time: 0.262532 Jul 28 01:20:08.877701 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 373/775] 10.222.0.17 () {60 vars in 1457 bytes} [Thu Jul 28 01:20:08 2022] DELETE /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-volume_attachments/92cf8f8f-7182-44ab-9fb5-8c9ae5b09db3 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:20:08.901536 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:08.902391 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:08.909921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.910381 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.911129 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.911558 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.940217 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:08.940938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:08.948221 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.948670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.949434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:08.949863 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:08.971541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:08.984444 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117960) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 01:20:09.067715 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-64960102-93fc-4ac7-b9f0-9888f876c602 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "POST /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/action" status: 202 len: 0 microversion: 2.20 time: 0.130802 Jul 28 01:20:09.071101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 374/776] 10.222.0.17 () {62 vars in 1319 bytes} [Thu Jul 28 01:20:08 2022] POST /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 01:20:09.077920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:09.078194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:09.078810 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:09.085925 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e0c52f3b-6f1b-4bbf-a656-c69d49ebb19b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1318 microversion: 2.1 time: 0.188285 Jul 28 01:20:09.086207 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:09.087799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 403/777] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:08 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:09.095240 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:09.096417 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:09.097278 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:09.263002 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:09.271984 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:09.273395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:09.274570 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-bea795c7-996f-48a8-982a-5b87c7389640 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1672 microversion: 2.20 time: 0.202271 Jul 28 01:20:09.275154 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 375/778] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:09 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1672 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:10.107594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:10.108304 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:10.115426 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.115878 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.118161 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.118161 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.261530 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-bb2173e3-66af-4dd3-9e4b-0ab276471677 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:10.263951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-bb2173e3-66af-4dd3-9e4b-0ab276471677 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:10.270052 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:10.270931 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb2173e3-66af-4dd3-9e4b-0ab276471677 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.271413 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb2173e3-66af-4dd3-9e4b-0ab276471677 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.272245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb2173e3-66af-4dd3-9e4b-0ab276471677 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.272685 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bb2173e3-66af-4dd3-9e4b-0ab276471677 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.277987 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bea27a63-1f49-42e7-9cbf-8037667367e0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1507 microversion: 2.1 time: 0.174335 Jul 28 01:20:10.278510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 404/779] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:10 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:10.300527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:10.301403 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:10.305411 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-bb2173e3-66af-4dd3-9e4b-0ab276471677 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047891 Jul 28 01:20:10.306004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 376/780] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:20:10 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:20:10.308403 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.308845 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.309613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.310038 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.447769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:10.450115 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e96f89ff-fa26-4abd-94b3-5eee163a92d4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:10.450717 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e96f89ff-fa26-4abd-94b3-5eee163a92d4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:10.458982 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e96f89ff-fa26-4abd-94b3-5eee163a92d4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.459586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e96f89ff-fa26-4abd-94b3-5eee163a92d4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.459962 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:10.461549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:10.462722 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-15bf95e0-4d69-494e-8953-bb7a6f6ae314 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.167289 Jul 28 01:20:10.463318 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 405/781] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:10 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:10.463449 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e96f89ff-fa26-4abd-94b3-5eee163a92d4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.463993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e96f89ff-fa26-4abd-94b3-5eee163a92d4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.499382 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e96f89ff-fa26-4abd-94b3-5eee163a92d4 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/b7adcae5-e1b5-4fc2-9351-cf358cf61169" status: 200 len: 194 microversion: 2.1 time: 0.053500 Jul 28 01:20:10.505379 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 377/782] 10.222.0.17 () {58 vars in 1413 bytes} [Thu Jul 28 01:20:10 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/b7adcae5-e1b5-4fc2-9351-cf358cf61169 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:10.511997 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:10.512496 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:10.519162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.519831 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.520612 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:10.521067 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:10.618292 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lazy-loading 'services' on Instance uuid ee97a8c0-2311-4bee-a11d-43aed93845f6 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:20:10.712923 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f821cb1e-aca8-469c-8e3d-a1f628b20025 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/b7adcae5-e1b5-4fc2-9351-cf358cf61169" status: 202 len: 0 microversion: 2.1 time: 0.205872 Jul 28 01:20:10.713763 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 406/783] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:20:10 2022] DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/b7adcae5-e1b5-4fc2-9351-cf358cf61169 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:20:11.486055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:11.486658 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:11.493672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:11.494115 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:11.494930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:11.495336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:11.713109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:11.722159 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:11.723794 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:11.724989 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8282d899-e652-47dc-9bbd-bcc111aa7622 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.242896 Jul 28 01:20:11.725527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 378/784] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:11 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:12.749243 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:12.749949 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:12.760511 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:12.760511 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:12.760511 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:12.760511 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:12.931493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dad422c7-9c6f-4abd-b288-238cecde62ad tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:12.932587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dad422c7-9c6f-4abd-b288-238cecde62ad tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:12.939435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dad422c7-9c6f-4abd-b288-238cecde62ad tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:12.940114 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dad422c7-9c6f-4abd-b288-238cecde62ad tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:12.941699 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dad422c7-9c6f-4abd-b288-238cecde62ad tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:12.942338 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dad422c7-9c6f-4abd-b288-238cecde62ad tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:12.956532 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:12.968481 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:12.970875 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:12.972858 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-33bddee8-35bc-4f27-b258-fb4952a70bb6 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.228309 Jul 28 01:20:12.973724 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 407/785] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:12 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:12.991323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dad422c7-9c6f-4abd-b288-238cecde62ad tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/80757411-b942-4f50-a54d-4df8a990fdb2" status: 200 len: 194 microversion: 2.1 time: 0.068960 Jul 28 01:20:12.999085 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 379/786] 10.222.0.17 () {58 vars in 1413 bytes} [Thu Jul 28 01:20:12 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/80757411-b942-4f50-a54d-4df8a990fdb2 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:13.014716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:13.015707 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:13.022734 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:13.023204 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:13.024334 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:13.028797 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:13.136173 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lazy-loading 'services' on Instance uuid ee97a8c0-2311-4bee-a11d-43aed93845f6 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:20:13.228655 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ef4e043b-d888-477d-b709-0f385086bf8d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/80757411-b942-4f50-a54d-4df8a990fdb2" status: 202 len: 0 microversion: 2.1 time: 0.219732 Jul 28 01:20:13.230425 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 408/787] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:20:13 2022] DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments/80757411-b942-4f50-a54d-4df8a990fdb2 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:20:14.006828 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:14.007613 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:14.015352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:14.015807 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:14.016587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:14.016985 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:14.165179 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:14.174010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:14.175688 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:14.177173 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-15f2d3e1-3ee2-4a82-96e8-a63a29fae2e8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.175235 Jul 28 01:20:14.178016 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 380/788] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:14 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:15.202781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:15.203503 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:15.210346 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:15.210803 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:15.211631 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:15.212064 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:15.354233 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:15.363665 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:15.365525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:15.366427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85e2fea0-afbc-4787-990c-4f0b590d196f tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.168473 Jul 28 01:20:15.379568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 409/789] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:15 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:16.395456 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:16.396624 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:16.404372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:16.404815 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:16.405596 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:16.406032 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:16.581814 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:16.592946 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:16.594579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:16.595904 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e361b0d7-6380-4e24-868f-d734c406a566 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.208318 Jul 28 01:20:16.596670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 381/790] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:16 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:17.621493 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:17.622200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:17.632980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:17.633799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:17.635261 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:17.635974 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:17.643271 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:17.790102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:17.799799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:17.801500 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:17.804708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bd145930-34cb-40d9-ab9a-127e6e3caa0c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.187318 Jul 28 01:20:17.805957 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 410/791] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:17 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:18.829358 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:18.829964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:18.837156 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:18.837579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:18.841628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:18.841628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:19.007883 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:19.016758 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:19.018515 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:19.019860 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-74488429-0231-40d6-ab9d-f23f862cb380 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.194587 Jul 28 01:20:19.020614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 382/792] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:18 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:20.045244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:20.045989 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:20.053134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:20.053871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:20.055012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:20.055746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:20.206034 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:20.214281 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:20.215808 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:20.216981 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-64b455b5-7c3a-47a8-8ba4-03115440cbc0 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.175901 Jul 28 01:20:20.217748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 411/793] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:20 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:21.239645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:21.240394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:21.247372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:21.247818 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:21.248632 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:21.249061 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:21.384754 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:21.394143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:21.395705 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:21.396972 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-14f6e5b7-e060-4bb6-84b3-fd12ec261ae2 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.161242 Jul 28 01:20:21.397451 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 383/794] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:21 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:22.423384 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:22.424160 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:22.431388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:22.431892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:22.432674 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:22.433107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:22.853899 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:22.865841 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:22.868249 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:22.869989 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2cfede89-5450-4834-8e2d-62c53f1a14e3 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.452042 Jul 28 01:20:22.870782 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 412/795] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:22 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:22.988210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2520a57b-4a2e-4c2f-8662-ccc01506b711 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:22.990472 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2520a57b-4a2e-4c2f-8662-ccc01506b711 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:22.997636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2520a57b-4a2e-4c2f-8662-ccc01506b711 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:22.998083 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2520a57b-4a2e-4c2f-8662-ccc01506b711 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:22.998873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2520a57b-4a2e-4c2f-8662-ccc01506b711 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:22.999327 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2520a57b-4a2e-4c2f-8662-ccc01506b711 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.029803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2520a57b-4a2e-4c2f-8662-ccc01506b711 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045628 Jul 28 01:20:23.030379 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 384/796] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:20:22 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:20:23.151081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-75055f9a-c1ad-4e18-9e1f-f58a04d23b70 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:23.153314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-75055f9a-c1ad-4e18-9e1f-f58a04d23b70 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:23.159952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-75055f9a-c1ad-4e18-9e1f-f58a04d23b70 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.160396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-75055f9a-c1ad-4e18-9e1f-f58a04d23b70 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.161162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-75055f9a-c1ad-4e18-9e1f-f58a04d23b70 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.161566 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-75055f9a-c1ad-4e18-9e1f-f58a04d23b70 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.190745 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-75055f9a-c1ad-4e18-9e1f-f58a04d23b70 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043966 Jul 28 01:20:23.191350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 413/797] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:20:23 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:20:23.262973 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:23.263471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:23.270077 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.270529 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.271340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.271835 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.299201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:20:23.380468 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5197fde5-050d-42f0-b084-53d035e18581 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 204 len: 0 microversion: 2.1 time: 0.120639 Jul 28 01:20:23.381060 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 385/798] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:20:23 2022] DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:20:23.391563 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:23.392176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:23.398666 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.399152 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.399927 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.400355 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.538657 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:23.546509 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-11e93528-764c-4d1d-a105-5fca5a8d193d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1672 microversion: 2.1 time: 0.159662 Jul 28 01:20:23.547178 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 414/799] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:23 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:20:23.896808 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:23.897430 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:23.904020 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.904475 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:23.905242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:23.905676 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:24.043013 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:24.051756 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:24.053502 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:24.054806 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-00ac236c-0a91-4855-8ca8-c3a337734aff tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.162568 Jul 28 01:20:24.055446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 386/800] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:23 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:24.567580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:24.568425 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:24.575513 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:24.575971 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:24.576732 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:24.577175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:24.710999 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:24.718902 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dfd94d80-c766-47b7-8fe1-39e229c12aa0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1672 microversion: 2.1 time: 0.155329 Jul 28 01:20:24.719518 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 415/801] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:24 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:25.079383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:25.080001 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:25.087301 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:25.087744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:25.088516 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:25.088941 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:25.229089 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:25.240287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:25.241776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:25.242955 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9deba994-0dd8-4d7d-a52e-ef2de367c736 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.167691 Jul 28 01:20:25.243512 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 387/802] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:25 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:25.739851 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:25.740622 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:25.747590 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:25.748045 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:25.748883 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:25.749359 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:25.980714 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:25.988879 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6454b13b-2941-4a2a-8fb0-01a423036fc0 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1672 microversion: 2.1 time: 0.253095 Jul 28 01:20:25.989615 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 416/803] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:25 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:26.089704 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-4604a99c-a809-4b4c-bc17-87b43d7e81d0 req-51b003ae-765b-4ad5-bf45-5f85c6cfeada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035e590-ae9f-4fb3-ac7f-3615a1ce992c", "name": "network-vif-plugged", "status": "completed", "tag": "bd4676aa-4815-4dd2-8cfe-5bab28819f71"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:26.095301 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:26.101594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-4604a99c-a809-4b4c-bc17-87b43d7e81d0 req-51b003ae-765b-4ad5-bf45-5f85c6cfeada service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:26.102263 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-4604a99c-a809-4b4c-bc17-87b43d7e81d0 req-51b003ae-765b-4ad5-bf45-5f85c6cfeada service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:26.115433 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-4604a99c-a809-4b4c-bc17-87b43d7e81d0 req-51b003ae-765b-4ad5-bf45-5f85c6cfeada service nova] Creating event network-vif-plugged:bd4676aa-4815-4dd2-8cfe-5bab28819f71 for instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c on hv-cinder-81558 Jul 28 01:20:26.121019 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-4604a99c-a809-4b4c-bc17-87b43d7e81d0 req-51b003ae-765b-4ad5-bf45-5f85c6cfeada service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035079 Jul 28 01:20:26.121715 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 388/804] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:26.269284 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:26.269925 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:26.276337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:26.276974 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:26.277765 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:26.278197 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:26.489663 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:26.498126 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:26.499760 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:26.500917 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a6dd6cba-68c9-4b78-8736-b6d0100d8d5d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.235735 Jul 28 01:20:26.501474 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 417/805] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:26 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:26.612467 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-a33935bf-e15c-414a-b0c2-23ec4b52d4b5 req-650c741e-542e-4754-9219-ed2273b101e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee97a8c0-2311-4bee-a11d-43aed93845f6", "name": "network-vif-deleted", "tag": "54ea0962-d401-489d-86eb-52f3bf0b9f65"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:26.631692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-a33935bf-e15c-414a-b0c2-23ec4b52d4b5 req-650c741e-542e-4754-9219-ed2273b101e2 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:26.632149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-a33935bf-e15c-414a-b0c2-23ec4b52d4b5 req-650c741e-542e-4754-9219-ed2273b101e2 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:26.636560 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:26.648638 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-a33935bf-e15c-414a-b0c2-23ec4b52d4b5 req-650c741e-542e-4754-9219-ed2273b101e2 service nova] Creating event network-vif-deleted:54ea0962-d401-489d-86eb-52f3bf0b9f65 for instance ee97a8c0-2311-4bee-a11d-43aed93845f6 on hv-cinder-81558 Jul 28 01:20:26.654481 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-a33935bf-e15c-414a-b0c2-23ec4b52d4b5 req-650c741e-542e-4754-9219-ed2273b101e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046380 Jul 28 01:20:26.655142 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 389/806] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:20:26.762738 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b611e7d1-bfda-4e3e-afb7-84b7d7d6336b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0863650a-c922-450c-9748-b64edccf4332", "device": "/dev/sdb"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:26.765832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b611e7d1-bfda-4e3e-afb7-84b7d7d6336b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:26.772811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b611e7d1-bfda-4e3e-afb7-84b7d7d6336b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:26.773263 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b611e7d1-bfda-4e3e-afb7-84b7d7d6336b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:26.774054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b611e7d1-bfda-4e3e-afb7-84b7d7d6336b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:26.774490 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b611e7d1-bfda-4e3e-afb7-84b7d7d6336b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:27.010772 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:27.011855 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:27.019176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:27.019615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:27.020405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:27.020844 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:27.055432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:27.055884 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:27.056335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lazy-loading 'fault' on Instance uuid ee97a8c0-2311-4bee-a11d-43aed93845f6 {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:20:27.103584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ab1df6f15143de8f922a626317fa9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347bcdc7636e4f93af2597f853926b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:27.111321 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8e8f3d74-cfd0-4817-b0cc-d39ce3eedc64 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 200 len: 1327 microversion: 2.1 time: 0.104749 Jul 28 01:20:27.111873 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 390/807] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:27 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:27.494488 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b611e7d1-bfda-4e3e-afb7-84b7d7d6336b tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "POST /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737650 Jul 28 01:20:27.495266 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 418/808] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:20:26 2022] POST /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:27.525223 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:27.525840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:27.532473 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:27.533175 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:27.534111 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:27.534748 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:27.677647 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:27.685946 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:27.687484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:27.688692 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ce2f2cf2-5406-4efb-bd0b-e4fe49422f67 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1730 microversion: 2.20 time: 0.167627 Jul 28 01:20:27.689257 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 391/809] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:27 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:28.135571 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:28.136244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:28.138211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:28.145188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:28.145633 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:28.146639 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:28.147100 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:28.164994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] HTTP exception thrown: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Request method failure captured: Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 HTTP/1.1 Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLQNCQE8hDOGbf4fw6aqqod2ZSToBajXpjPsGYdDU_yGCeA6O5abu098UclF9R0y7mwZadpZ6Q0YQHMeRj-9JoHjOUhkTVg9Uiiw40rMHNZI9vtQk94PYAnPSKHaIom8DBCNKLdDpa9fRVDBekG0lkP502-0ENelL2GaDP7B0wEt6M Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:20:28.166811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_347bcdc7636e4f93af2597f853926b13", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: c8ab1df6f15143de8f922a626317fa9c Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:28.168531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'ee97a8c0-2311-4bee-a11d-43aed93845f6'} Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:28.169779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:28.171170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:28.172414 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Returning 404 to user: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:28.172414 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6d0360a9-c9d3-4c39-9109-b32f527066be tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 404 len: 111 microversion: 2.1 time: 0.039751 Jul 28 01:20:28.172414 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 419/810] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:28 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:28.178540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-3723ea40-1a85-4058-b176-33340a56f77c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '.version_select at 0x7ff71c506310>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:28.198900 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-3723ea40-1a85-4058-b176-33340a56f77c tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542252289" status: 202 len: 0 microversion: 2.1 time: 0.025084 Jul 28 01:20:28.199588 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 392/811] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Jul 28 01:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542252289 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:20:28.712847 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:28.713438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:28.719346 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:28.719783 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:28.720541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:28.720961 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:28.936095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:28.945335 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:28.946823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:28.948006 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-874fbb3e-330e-4935-9559-e8b552f2f542 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1717 microversion: 2.20 time: 0.239790 Jul 28 01:20:28.948545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 420/812] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:20:28 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1717 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:20:31.240988 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:31.241539 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:31.249190 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:31.249632 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:31.250405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:31.250862 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:31.264680 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] HTTP exception thrown: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Request method failure captured: Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 HTTP/1.1 Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLQNCQE8hDOGbf4fw6aqqod2ZSToBajXpjPsGYdDU_yGCeA6O5abu098UclF9R0y7mwZadpZ6Q0YQHMeRj-9JoHjOUhkTVg9Uiiw40rMHNZI9vtQk94PYAnPSKHaIom8DBCNKLdDpa9fRVDBekG0lkP502-0ENelL2GaDP7B0wEt6M Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:20:31.266369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_347bcdc7636e4f93af2597f853926b13", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: c8ab1df6f15143de8f922a626317fa9c Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.267953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'ee97a8c0-2311-4bee-a11d-43aed93845f6'} Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:31.268812 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.270145 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.271468 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Returning 404 to user: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:31.271468 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-21520250-8a4e-43a1-89d7-aac20ea3e44d tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 404 len: 111 microversion: 2.1 time: 0.030945 Jul 28 01:20:31.271468 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 393/813] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:20:31 2022] DELETE /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:31.276503 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:31.277117 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: ee97a8c0-2311-4bee-a11d-43aed93845f6] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:31.283860 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:31.284326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:31.285118 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:31.285527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:31.299886 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] HTTP exception thrown: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Request method failure captured: Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 HTTP/1.1 Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLQNCQE8hDOGbf4fw6aqqod2ZSToBajXpjPsGYdDU_yGCeA6O5abu098UclF9R0y7mwZadpZ6Q0YQHMeRj-9JoHjOUhkTVg9Uiiw40rMHNZI9vtQk94PYAnPSKHaIom8DBCNKLdDpa9fRVDBekG0lkP502-0ENelL2GaDP7B0wEt6M Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:20:31.301452 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_347bcdc7636e4f93af2597f853926b13", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: c8ab1df6f15143de8f922a626317fa9c Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.303107 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'ee97a8c0-2311-4bee-a11d-43aed93845f6'} Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:31.304144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. Jul 28 01:20:31.305741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:31.307059 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Returning 404 to user: Instance ee97a8c0-2311-4bee-a11d-43aed93845f6 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:31.307059 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3d16f8bc-6fb4-42a7-88b8-b79906f175e7 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6" status: 404 len: 111 microversion: 2.1 time: 0.030356 Jul 28 01:20:31.307059 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 421/814] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:31 2022] GET /compute/v2.1/servers/ee97a8c0-2311-4bee-a11d-43aed93845f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:32.478160 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:32.478859 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:32.485986 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:32.486440 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:32.487255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:32.487690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:32.501267 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] HTTP exception thrown: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Request method failure captured: Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: DELETE /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 HTTP/1.1 Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLQNCQE8hDOGbf4fw6aqqod2ZSToBajXpjPsGYdDU_yGCeA6O5abu098UclF9R0y7mwZadpZ6Q0YQHMeRj-9JoHjOUhkTVg9Uiiw40rMHNZI9vtQk94PYAnPSKHaIom8DBCNKLdDpa9fRVDBekG0lkP502-0ENelL2GaDP7B0wEt6M Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:20:32.502784 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_347bcdc7636e4f93af2597f853926b13", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: c8ab1df6f15143de8f922a626317fa9c Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.504401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '0b3c75a9-eb23-4978-bb95-53fe1e079f36'} Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:32.505740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.507374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.508726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Returning 404 to user: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:32.508726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b3757446-9c6e-40f2-98ae-d140224a2d95 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 404 len: 111 microversion: 2.1 time: 0.030530 Jul 28 01:20:32.508726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 394/815] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:20:32 2022] DELETE /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:32.513333 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:32.513969 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] [instance: 0b3c75a9-eb23-4978-bb95-53fe1e079f36] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:32.520508 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:32.520959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:32.521834 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:32.522247 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:32.535925 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] HTTP exception thrown: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Request method failure captured: Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 HTTP/1.1 Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLQNCQE8hDOGbf4fw6aqqod2ZSToBajXpjPsGYdDU_yGCeA6O5abu098UclF9R0y7mwZadpZ6Q0YQHMeRj-9JoHjOUhkTVg9Uiiw40rMHNZI9vtQk94PYAnPSKHaIom8DBCNKLdDpa9fRVDBekG0lkP502-0ENelL2GaDP7B0wEt6M Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:20:32.537543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_347bcdc7636e4f93af2597f853926b13", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/347bcdc7636e4f93af2597f853926b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 347bcdc7636e4f93af2597f853926b13 Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-511710801 Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: c8ab1df6f15143de8f922a626317fa9c Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-511710801-project Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.539070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '0b3c75a9-eb23-4978-bb95-53fe1e079f36'} Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:32.539811 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. Jul 28 01:20:32.541012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:32.542141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] Returning 404 to user: Instance 0b3c75a9-eb23-4978-bb95-53fe1e079f36 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:32.542141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a5575df-c235-43a1-85d5-54d4e811c1e5 tempest-AttachVolumeTestJSON-511710801 tempest-AttachVolumeTestJSON-511710801-project] 10.222.0.17 "GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36" status: 404 len: 111 microversion: 2.1 time: 0.029530 Jul 28 01:20:32.542141 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 422/816] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:32 2022] GET /compute/v2.1/servers/0b3c75a9-eb23-4978-bb95-53fe1e079f36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:35.657907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:35.658592 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:35.666130 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:35.666907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:35.667912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:35.668557 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:35.692556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lazy-loading 'flavor' on Instance uuid 183b3616-c163-4cad-a062-6d0637e9d642 {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:20:35.777119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2603938e-7c21-41eb-ae5f-e5ce59529bf8 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "POST /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642/action" status: 202 len: 0 microversion: 2.1 time: 0.123120 Jul 28 01:20:35.781630 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 395/817] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:20:35 2022] POST /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:20:35.786314 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:35.787025 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:35.794536 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:35.795109 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:35.796095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:35.796529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:35.995467 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:36.006011 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-aeb7dc81-fb08-4534-a279-931d10175f04 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.223380 Jul 28 01:20:36.007053 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 423/818] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:35 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:20:37.034687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:37.035871 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:37.045860 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:37.046620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:37.047879 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:37.048599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:37.191068 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:37.199599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-88ff4158-c85c-4bcb-9a2a-dc377c923635 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.172890 Jul 28 01:20:37.200210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 396/819] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:37 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:37.223405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d6a1a2c-9ef3-49f4-a131-83a83bfbd2aa tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Action: 'create', calling method: .version_select at 0x7ff71c4f8c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-400990913", "metadata": {"Type": "work"}}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d6a1a2c-9ef3-49f4-a131-83a83bfbd2aa tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Request method failure captured: Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 121 Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eRle59Xya-_lMdzHdgJEe8GgU_6xakNVXLhOFVc0jrKXcKpEdLrbT_esRrm9ZlKDhRBcc7XOyrx2AtlS3ijFQxWOSZS_vgRYNQaIeOKJ6FRhD40VkaqbdPlYPwG53iqpiTfOEQyeDx5pgup8Leh5UtobPUMfy4Nd_9uNug5eyhrREc Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:20:37.249573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7a91b709d6b44fb9759898679a53ac6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 7eb797f227d949f092f7328f5b0f0ee7 Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-400990913", "metadata": {"Type": "work"}}} Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:20:37.251269 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-400990913', 'metadata': {'Type': 'work'}}}} Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise error Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:37.252255 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 01:20:37.253867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 01:20:37.255672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 01:20:37.255672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.255672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d6a1a2c-9ef3-49f4-a131-83a83bfbd2aa tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:37.255672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d6a1a2c-9ef3-49f4-a131-83a83bfbd2aa tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143955 Jul 28 01:20:37.255672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 424/820] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Jul 28 01:20:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 01:20:37.260499 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-21db57ab-2ba2-4ea5-be37-37f0ebed917a tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Action: 'create', calling method: .version_select at 0x7ff71c4a50d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-741254088", "metadata": {"Type": "work"}}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-21db57ab-2ba2-4ea5-be37-37f0ebed917a tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Request method failure captured: Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 119 Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eRle59Xya-_lMdzHdgJEe8GgU_6xakNVXLhOFVc0jrKXcKpEdLrbT_esRrm9ZlKDhRBcc7XOyrx2AtlS3ijFQxWOSZS_vgRYNQaIeOKJ6FRhD40VkaqbdPlYPwG53iqpiTfOEQyeDx5pgup8Leh5UtobPUMfy4Nd_9uNug5eyhrREc Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:20:37.265464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7a91b709d6b44fb9759898679a53ac6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 7eb797f227d949f092f7328f5b0f0ee7 Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-741254088", "metadata": {"Type": "work"}}} Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: Jul 28 01:20:37.267088 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-741254088', 'metadata': {'Type': 'work'}}}} Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise error Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi '0' Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:37.268603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 01:20:37.270421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 01:20:37.271771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 01:20:37.271771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.271771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-21db57ab-2ba2-4ea5-be37-37f0ebed917a tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:37.271771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-21db57ab-2ba2-4ea5-be37-37f0ebed917a tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015266 Jul 28 01:20:37.271771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 397/821] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Jul 28 01:20:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:20:37.277213 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d887f6fb-1a5d-4bb2-b35e-b12a30f96fd2 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Action: 'create', calling method: .version_select at 0x7ff71c431ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-885377751", "metadata": {"Type": "work"}}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d887f6fb-1a5d-4bb2-b35e-b12a30f96fd2 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Request method failure captured: Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 118 Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eRle59Xya-_lMdzHdgJEe8GgU_6xakNVXLhOFVc0jrKXcKpEdLrbT_esRrm9ZlKDhRBcc7XOyrx2AtlS3ijFQxWOSZS_vgRYNQaIeOKJ6FRhD40VkaqbdPlYPwG53iqpiTfOEQyeDx5pgup8Leh5UtobPUMfy4Nd_9uNug5eyhrREc Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:20:37.281733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7a91b709d6b44fb9759898679a53ac6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 7eb797f227d949f092f7328f5b0f0ee7 Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-885377751", "metadata": {"Type": "work"}}} Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:20:37.283409 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-885377751', 'metadata': {'Type': 'work'}}}} Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise error Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi '' Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:37.284338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 01:20:37.285882 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 01:20:37.287232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 01:20:37.287232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.287232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d887f6fb-1a5d-4bb2-b35e-b12a30f96fd2 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:37.287232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d887f6fb-1a5d-4bb2-b35e-b12a30f96fd2 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009879 Jul 28 01:20:37.287232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 425/822] 10.222.0.17 () {60 vars in 1156 bytes} [Thu Jul 28 01:20:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 01:20:37.292650 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eefa9da2-7df3-470f-85e5-fa3cfb8bbfa9 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Calling method '.version_select at 0x7ff71c4fba60>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:37.321468 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-eefa9da2-7df3-470f-85e5-fa3cfb8bbfa9 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] HTTP exception thrown: Volume tempest-invalid-1535666459 could not be found. Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eefa9da2-7df3-470f-85e5-fa3cfb8bbfa9 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Request method failure captured: Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1535666459 HTTP/1.1 Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eRle59Xya-_lMdzHdgJEe8GgU_6xakNVXLhOFVc0jrKXcKpEdLrbT_esRrm9ZlKDhRBcc7XOyrx2AtlS3ijFQxWOSZS_vgRYNQaIeOKJ6FRhD40VkaqbdPlYPwG53iqpiTfOEQyeDx5pgup8Leh5UtobPUMfy4Nd_9uNug5eyhrREc Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:20:37.324776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7a91b709d6b44fb9759898679a53ac6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 7eb797f227d949f092f7328f5b0f0ee7 Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Volume tempest-invalid-1535666459 could not be found. Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'tempest-invalid-1535666459'} Jul 28 01:20:37.326387 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1535666459 could not be found. (HTTP 404) (Request-ID: req-168d6ec0-fb6b-4e45-97df-989ee1de47c6) Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.327315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 01:20:37.328556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1535666459 could not be found. Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:37.329771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1535666459 could not be found. Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1535666459 could not be found. Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eefa9da2-7df3-470f-85e5-fa3cfb8bbfa9 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Returning 404 to user: Volume tempest-invalid-1535666459 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-eefa9da2-7df3-470f-85e5-fa3cfb8bbfa9 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1535666459" status: 404 len: 99 microversion: 2.1 time: 0.037475 Jul 28 01:20:37.332752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 398/823] 10.222.0.17 () {58 vars in 1218 bytes} [Thu Jul 28 01:20:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1535666459 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 01:20:37.335893 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bfeb83d9-86ff-4b2d-99dc-97bade9b19f5 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003928 Jul 28 01:20:37.336625 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 426/824] 10.222.0.17 () {58 vars in 1140 bytes} [Thu Jul 28 01:20:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 01:20:37.347383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4cd832e3-bd70-49ee-b7f5-a5990d413058 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005080 Jul 28 01:20:37.348142 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 399/825] 10.222.0.17 () {58 vars in 1137 bytes} [Thu Jul 28 01:20:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 01:20:37.357000 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-97202b3c-b920-4e38-a058-59212a6d84d6 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Calling method '.version_select at 0x7ff71c3eb9d0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:37.386394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-97202b3c-b920-4e38-a058-59212a6d84d6 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] HTTP exception thrown: Volume 9f6ed4a7-7896-482a-b3d0-9704c2821fe3 could not be found. Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-97202b3c-b920-4e38-a058-59212a6d84d6 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Request method failure captured: Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/os-volumes/9f6ed4a7-7896-482a-b3d0-9704c2821fe3 HTTP/1.1 Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eRle59Xya-_lMdzHdgJEe8GgU_6xakNVXLhOFVc0jrKXcKpEdLrbT_esRrm9ZlKDhRBcc7XOyrx2AtlS3ijFQxWOSZS_vgRYNQaIeOKJ6FRhD40VkaqbdPlYPwG53iqpiTfOEQyeDx5pgup8Leh5UtobPUMfy4Nd_9uNug5eyhrREc Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:20:37.388351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7a91b709d6b44fb9759898679a53ac6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 7eb797f227d949f092f7328f5b0f0ee7 Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Volume 9f6ed4a7-7896-482a-b3d0-9704c2821fe3 could not be found. Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '9f6ed4a7-7896-482a-b3d0-9704c2821fe3'} Jul 28 01:20:37.390007 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f6ed4a7-7896-482a-b3d0-9704c2821fe3 could not be found. (HTTP 404) (Request-ID: req-f5588cfa-28db-4ecd-91e6-e5c56c50444d) Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.390980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 01:20:37.392354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f6ed4a7-7896-482a-b3d0-9704c2821fe3 could not be found. Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 01:20:37.393772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f6ed4a7-7896-482a-b3d0-9704c2821fe3 could not be found. Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f6ed4a7-7896-482a-b3d0-9704c2821fe3 could not be found. Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-97202b3c-b920-4e38-a058-59212a6d84d6 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Returning 404 to user: Volume 9f6ed4a7-7896-482a-b3d0-9704c2821fe3 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-97202b3c-b920-4e38-a058-59212a6d84d6 tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/9f6ed4a7-7896-482a-b3d0-9704c2821fe3" status: 404 len: 109 microversion: 2.1 time: 0.036762 Jul 28 01:20:37.395108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 427/826] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:20:37 2022] DELETE /compute/v2.1/os-volumes/9f6ed4a7-7896-482a-b3d0-9704c2821fe3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:37.399748 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5863bbdb-fd4b-442f-90af-7444c4796e2d tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Calling method '.version_select at 0x7ff71c4a5b80>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:37.427690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-5863bbdb-fd4b-442f-90af-7444c4796e2d tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] HTTP exception thrown: Volume ca079c99-71d7-4068-8c33-621e132bdbe6 could not be found. Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5863bbdb-fd4b-442f-90af-7444c4796e2d tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Request method failure captured: Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/os-volumes/ca079c99-71d7-4068-8c33-621e132bdbe6 HTTP/1.1 Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eRle59Xya-_lMdzHdgJEe8GgU_6xakNVXLhOFVc0jrKXcKpEdLrbT_esRrm9ZlKDhRBcc7XOyrx2AtlS3ijFQxWOSZS_vgRYNQaIeOKJ6FRhD40VkaqbdPlYPwG53iqpiTfOEQyeDx5pgup8Leh5UtobPUMfy4Nd_9uNug5eyhrREc Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:20:37.429645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d7a91b709d6b44fb9759898679a53ac6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d7a91b709d6b44fb9759898679a53ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: d7a91b709d6b44fb9759898679a53ac6 Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-VolumesNegativeTest-1421152694 Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 7eb797f227d949f092f7328f5b0f0ee7 Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-VolumesNegativeTest-1421152694-project Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Volume ca079c99-71d7-4068-8c33-621e132bdbe6 could not be found. Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'ca079c99-71d7-4068-8c33-621e132bdbe6'} Jul 28 01:20:37.431334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca079c99-71d7-4068-8c33-621e132bdbe6 could not be found. (HTTP 404) (Request-ID: req-cdc582dc-8a32-4403-b6b4-4fb20bd399e3) Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.432271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 01:20:37.433664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca079c99-71d7-4068-8c33-621e132bdbe6 could not be found. Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 01:20:37.434938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca079c99-71d7-4068-8c33-621e132bdbe6 could not be found. Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca079c99-71d7-4068-8c33-621e132bdbe6 could not be found. Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5863bbdb-fd4b-442f-90af-7444c4796e2d tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] Returning 404 to user: Volume ca079c99-71d7-4068-8c33-621e132bdbe6 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5863bbdb-fd4b-442f-90af-7444c4796e2d tempest-VolumesNegativeTest-1421152694 tempest-VolumesNegativeTest-1421152694-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ca079c99-71d7-4068-8c33-621e132bdbe6" status: 404 len: 109 microversion: 2.1 time: 0.035200 Jul 28 01:20:37.436213 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 400/827] 10.222.0.17 () {58 vars in 1245 bytes} [Thu Jul 28 01:20:37 2022] GET /compute/v2.1/os-volumes/ca079c99-71d7-4068-8c33-621e132bdbe6 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:38.222002 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:38.222623 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:38.229094 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:38.229706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:38.230322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:38.230856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:38.379495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:38.393832 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2a37c28c-e203-4669-a1bb-ea68607ea603 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.177032 Jul 28 01:20:38.394600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 428/828] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:38 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:39.424953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:39.425568 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:39.432872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:39.433378 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:39.434214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:39.434983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:39.594392 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:39.606665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-97bb1e60-a97b-42bf-9908-26017f452493 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.186488 Jul 28 01:20:39.607346 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 401/829] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:39 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:40.631918 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:40.632807 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:40.639575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:40.640009 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:40.640783 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:40.641392 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:40.782884 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:40.790570 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2108c71c-7569-4c5b-8f67-c24cae484c3e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.163543 Jul 28 01:20:40.791186 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 429/830] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:40 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:41.812004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:41.812615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:41.819827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:41.820289 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:41.821059 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:41.821497 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:42.115670 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:42.128125 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ccb64953-9f01-4145-9371-7f68760b96d0 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.319901 Jul 28 01:20:42.129301 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 402/831] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:41 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:43.149471 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:43.150071 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:43.156557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:43.157012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:43.158443 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:43.163557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:43.308762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:43.316564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a194167c-6562-4dca-a415-a6626be7087a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.170885 Jul 28 01:20:43.317310 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 430/832] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:43 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:44.338877 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:44.339763 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:44.347324 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:44.348099 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:44.348886 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:44.349287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:44.531643 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:44.539707 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f0688d84-c850-42ae-84f1-5f68718d4f50 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.205023 Jul 28 01:20:44.540426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 403/833] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:44 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:45.561285 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:45.561938 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:45.569171 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:45.569622 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:45.570394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:45.570825 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:45.586323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:45.795368 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:45.803061 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-30b3b61e-241e-428a-88d7-8b623d1cc05a tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.245977 Jul 28 01:20:45.803636 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 431/834] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:45 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:46.825608 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:46.826195 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:46.833139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:46.833584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:46.834347 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:46.834770 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:46.975954 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:46.984372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-130543f5-22a1-46f0-92dd-3f35681c581f tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.163469 Jul 28 01:20:46.985101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 404/835] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:46 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:48.009068 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:48.009686 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:48.016338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:48.016790 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:48.017561 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:48.017998 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:48.160557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:48.168504 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d5df5fa4-ace8-4248-84e1-83c16da7355e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.164646 Jul 28 01:20:48.169070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 432/836] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:48 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:49.189771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:49.190383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:49.196511 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:49.196961 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:49.197724 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:49.198222 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:49.347435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:49.355077 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1920dafb-f995-4a05-bcbb-e29c97b54fc1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.169359 Jul 28 01:20:49.355658 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 405/837] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:49 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:50.375683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:50.376551 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:50.383819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:50.384384 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:50.385251 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:50.385787 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:50.551659 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:50.560683 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4e111996-d4bf-47bc-9297-80ac82b48136 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.188849 Jul 28 01:20:50.561451 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 433/838] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:50 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:51.463831 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:51.464432 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:51.471330 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:51.471786 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:51.472555 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:51.472977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:51.562166 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lazy-loading 'services' on Instance uuid d171e509-4b0b-4f14-beeb-9aebd8589468 {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:20:51.582557 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:51.583189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:51.589588 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:51.590027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:51.590949 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:51.591386 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:51.641988 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d8f2996e-1984-4bd5-8919-04080db45f17 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468/os-volume_attachments/0863650a-c922-450c-9748-b64edccf4332" status: 202 len: 0 microversion: 2.1 time: 0.181886 Jul 28 01:20:51.642560 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 406/839] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:20:51 2022] DELETE /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468/os-volume_attachments/0863650a-c922-450c-9748-b64edccf4332 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:20:51.771293 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:51.784290 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-93a605f3-a912-4d2e-bb81-83961a507cf6 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.206287 Jul 28 01:20:51.784887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 434/840] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:51 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:52.782695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:52.783285 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:52.789946 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:52.790393 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:52.791199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:52.791623 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:52.805610 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:52.806285 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:52.813476 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:52.813921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:52.814678 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:52.815140 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:52.819405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:20:52.901984 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e65cd132-3658-498f-bc67-5ce9e6d4cf93 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 204 len: 0 microversion: 2.1 time: 0.123900 Jul 28 01:20:52.903093 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 407/841] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:20:52 2022] DELETE /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:20:52.911620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:52.912472 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:52.918668 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:52.918897 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:52.919583 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:52.920008 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:52.924151 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:52.956711 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:52.964472 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6bde5af3-dd08-4b77-903d-c928bd1aa963 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.162655 Jul 28 01:20:52.965219 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 435/842] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:52 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:53.069652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:53.077795 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-039b0133-23dd-4c49-80d8-770d1cd7e1ec tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1513 microversion: 2.1 time: 0.170546 Jul 28 01:20:53.078380 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 408/843] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:52 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:53.989541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:53.990446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:54.001154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:54.001912 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:54.002707 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:54.003142 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:54.099747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:54.100476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:54.108406 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:54.108861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:54.109679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:54.110120 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:54.158681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:54.166569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b6e7154-f1f6-4292-bffc-337edcb865e5 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.182833 Jul 28 01:20:54.167157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 436/844] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:53 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:54.245709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:54.257077 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4a92a5c3-10ca-4e30-98d9-3dd937c41b86 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1513 microversion: 2.1 time: 0.161346 Jul 28 01:20:54.257665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 409/845] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:54 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:55.188448 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:55.189058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:55.195788 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:55.196238 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:55.197011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:55.197519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:55.221652 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-954139d8-03dd-488d-9617-b2fc239f99e9 req-b9200216-d10e-4e35-8f4b-b43ad6a07feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d171e509-4b0b-4f14-beeb-9aebd8589468", "name": "network-vif-deleted", "tag": "0cdf79c7-1022-469b-bd0d-5cb24728ad29"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:55.231529 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-954139d8-03dd-488d-9617-b2fc239f99e9 req-b9200216-d10e-4e35-8f4b-b43ad6a07feb service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:55.231973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-954139d8-03dd-488d-9617-b2fc239f99e9 req-b9200216-d10e-4e35-8f4b-b43ad6a07feb service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:55.243402 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-954139d8-03dd-488d-9617-b2fc239f99e9 req-b9200216-d10e-4e35-8f4b-b43ad6a07feb service nova] Creating event network-vif-deleted:0cdf79c7-1022-469b-bd0d-5cb24728ad29 for instance d171e509-4b0b-4f14-beeb-9aebd8589468 on hv-cinder-81558 Jul 28 01:20:55.248706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-954139d8-03dd-488d-9617-b2fc239f99e9 req-b9200216-d10e-4e35-8f4b-b43ad6a07feb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154579 Jul 28 01:20:55.249389 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 437/846] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:20:55.278311 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:55.279580 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:55.285877 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:55.286259 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:55.287066 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:55.287485 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:55.352420 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:55.360449 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-952544c6-4835-4c03-9a34-26e1134151b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.175866 Jul 28 01:20:55.361053 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 410/847] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:55 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:55.362923 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:55.370708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-96159066-01db-403d-8b90-1eba7dd556fd tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1471 microversion: 2.1 time: 0.096727 Jul 28 01:20:55.371470 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 438/848] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:55 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:20:56.381167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:56.381781 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:56.384117 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:56.389624 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:56.390080 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:56.390868 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:56.391335 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:56.392352 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:56.393053 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:56.399810 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:56.400326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:56.401162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:56.401671 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:56.433654 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:56.434095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:56.434547 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lazy-loading 'fault' on Instance uuid d171e509-4b0b-4f14-beeb-9aebd8589468 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:20:56.494527 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:56.502220 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5364a5f7-48ff-4241-a0d7-69691701c7b8 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 200 len: 1308 microversion: 2.1 time: 0.114054 Jul 28 01:20:56.502812 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 439/849] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:56 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:56.564951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:56.575809 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-1244e1e5-c22a-4974-ae7b-85036e103c34 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.198941 Jul 28 01:20:56.576390 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 411/850] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:56 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:57.524119 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:57.524756 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: d171e509-4b0b-4f14-beeb-9aebd8589468] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:57.531495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.532012 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:57.532829 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.533273 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:57.547257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] HTTP exception thrown: Instance d171e509-4b0b-4f14-beeb-9aebd8589468 could not be found. Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Request method failure captured: Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 HTTP/1.1 Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eQ72SHeAwrl4l1Qm4j4MAEwew8euQBO8w0i89yXmGSdTR66I85PA-R78FwpSRkx2d91SQRsbL6BS-51JuzRo9SQT7bPIbio7WI8YvyCo-Q8_Kt935zBgAT7fA4RMBiZnkoi6cA3AqVvhfb01xY9TJAC2LHAXNbTLACUZVYz3iMLxG0 Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 8840b41dd8364a8a976f04d4fe421b8e Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1780863891 Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:20:57.548869 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8840b41dd8364a8a976f04d4fe421b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8840b41dd8364a8a976f04d4fe421b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8840b41dd8364a8a976f04d4fe421b8e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8840b41dd8364a8a976f04d4fe421b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotTestJSON-1780863891 Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 8840b41dd8364a8a976f04d4fe421b8e Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1780863891 Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotTestJSON-1780863891-project Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 82a7db7a0f544b3eb9487bf00adbb742 Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotTestJSON-1780863891-project Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance d171e509-4b0b-4f14-beeb-9aebd8589468 could not be found. Jul 28 01:20:57.550525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'd171e509-4b0b-4f14-beeb-9aebd8589468'} Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d171e509-4b0b-4f14-beeb-9aebd8589468 could not be found. Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:20:57.551587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d171e509-4b0b-4f14-beeb-9aebd8589468 could not be found. Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d171e509-4b0b-4f14-beeb-9aebd8589468 could not be found. Jul 28 01:20:57.553108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:20:57.554857 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Returning 404 to user: Instance d171e509-4b0b-4f14-beeb-9aebd8589468 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:20:57.554857 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7adf3d6c-d48e-48f1-a158-cbfe491281ea tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468" status: 404 len: 111 microversion: 2.1 time: 0.030167 Jul 28 01:20:57.554857 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 440/851] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:57 2022] GET /compute/v2.1/servers/d171e509-4b0b-4f14-beeb-9aebd8589468 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:20:57.597173 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:57.597781 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:57.604747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.605123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:57.605931 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.606370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:57.750627 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:57.761875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-271c8301-bfe2-4323-a9ee-348f710807a7 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1509 microversion: 2.1 time: 0.168462 Jul 28 01:20:57.762551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 412/852] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:57 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:57.784479 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:20:57.785075 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:57.791103 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.791544 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:57.792300 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.792732 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:57.840047 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117958) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 01:20:57.919931 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0f9c7886-c770-456e-b3e3-ed4f2b8580d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "POST /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642/action" status: 202 len: 0 microversion: 2.1 time: 0.139443 Jul 28 01:20:57.920546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 441/853] 10.222.0.17 () {60 vars in 1278 bytes} [Thu Jul 28 01:20:57 2022] POST /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:20:57.928676 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:57.929423 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:57.935725 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.936201 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:57.936992 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:57.937386 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:58.081771 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:58.089411 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ff6d8844-b637-4747-82dd-aeddeeac85a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1517 microversion: 2.1 time: 0.164675 Jul 28 01:20:58.090218 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 413/854] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:57 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:20:59.110992 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:20:59.111576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:20:59.113524 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:20:59.119143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:59.119593 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:59.120362 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:20:59.120801 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:20:59.253481 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:20:59.265385 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5649cc25-20c1-4324-b7d5-fcc92698f990 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1517 microversion: 2.1 time: 0.158704 Jul 28 01:20:59.266116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 442/855] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:20:59 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:00.295288 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:00.296442 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:00.307434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:00.308028 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:00.309197 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:00.309858 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:00.448121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:00.456295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ce03779c-7307-494c-a14c-5058e48eeedb tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1519 microversion: 2.1 time: 0.167465 Jul 28 01:21:00.456897 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 414/856] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:00 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:00.681210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-93470d69-6a41-465a-956c-41a9a4ed5a3c req-bbaa7019-e486-400b-980b-c5cb7b497a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183b3616-c163-4cad-a062-6d0637e9d642", "name": "network-vif-unplugged", "status": "completed", "tag": "79e0f07f-163d-476a-bcb0-0be5f3ea5eff"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:00.692287 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-93470d69-6a41-465a-956c-41a9a4ed5a3c req-bbaa7019-e486-400b-980b-c5cb7b497a7b service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:00.692705 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-93470d69-6a41-465a-956c-41a9a4ed5a3c req-bbaa7019-e486-400b-980b-c5cb7b497a7b service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:00.706405 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.compute.server_external_events [req-93470d69-6a41-465a-956c-41a9a4ed5a3c req-bbaa7019-e486-400b-980b-c5cb7b497a7b service nova] Unable to find a host for instance 183b3616-c163-4cad-a062-6d0637e9d642. Dropping event network-vif-unplugged {{(pid=117958) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 01:21:00.707322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-93470d69-6a41-465a-956c-41a9a4ed5a3c req-bbaa7019-e486-400b-980b-c5cb7b497a7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030213 Jul 28 01:21:00.707926 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 443/857] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 01:21:01.478436 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:01.478436 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:01.485477 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:01.485930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:01.486708 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:01.487172 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:01.629548 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:01.639778 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c28d8d34-556e-47d9-92b1-3757325d5ca1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.165803 Jul 28 01:21:01.640379 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 415/858] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:01 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:02.664505 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:02.665415 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:02.676093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:02.676802 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:02.678072 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:02.678780 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:02.824029 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:02.835787 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59a3164b-048c-44e5-accb-0bcd832a7bf1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.177294 Jul 28 01:21:02.836545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 444/859] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:02 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:03.858897 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:03.859528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:03.866195 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:03.866635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:03.867434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:03.867875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:04.069599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:04.077986 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a90c463c-8d27-4f3b-83ef-e6f2893a4595 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.223079 Jul 28 01:21:04.078870 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 416/860] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:03 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:05.100120 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:05.100709 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:05.107652 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:05.108177 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:05.108930 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:05.109384 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:05.247373 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:05.255936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f046d548-98a7-4f27-ab14-47bb4d942f96 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.160113 Jul 28 01:21:05.256597 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 445/861] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:05 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:05.474284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1181201302", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "networks": [{"uuid": "0631c6f7-c6a9-43dd-81e8-03129aee137b"}]}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:05.529898 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] validate_networks() for [('0631c6f7-c6a9-43dd-81e8-03129aee137b', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:21:05.893965 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:21:05.894462 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:21:05.895070 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:21:05.895545 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:21:05.896020 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:21:05.906025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:05.906486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:05.907374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:05.907864 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:05.924312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Getting quotas for project 8840b41dd8364a8a976f04d4fe421b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:21:05.928957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Getting quotas for user 82a7db7a0f544b3eb9487bf00adbb742 and project 8840b41dd8364a8a976f04d4fe421b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:21:05.942339 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:21:05.944690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:21:05.999428 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f5e76982-21ad-4028-9137-06c6c99be785 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528789 Jul 28 01:21:06.000078 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 417/862] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:21:06.011273 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4104292c-1208-465e-bfd6-7f90366b66d6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:06.012022 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4104292c-1208-465e-bfd6-7f90366b66d6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:06.095336 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4104292c-1208-465e-bfd6-7f90366b66d6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:06.102265 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4104292c-1208-465e-bfd6-7f90366b66d6 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1219 microversion: 2.1 time: 0.094738 Jul 28 01:21:06.103005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 446/863] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:06 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:06.277445 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:06.278055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:06.285143 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:06.285899 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:06.286872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:06.287236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:06.452307 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:06.470176 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0df61acc-9107-49e0-b2e5-2b48ecc24ca4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.196436 Jul 28 01:21:06.471626 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 418/864] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:06 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:21:07.124345 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:07.125000 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:07.144266 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:07.144893 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:07.145900 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:07.146380 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:07.222993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:07.231144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a299c4d7-b59f-4f4d-afcb-3eebf16dff88 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1277 microversion: 2.1 time: 0.111941 Jul 28 01:21:07.232257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 447/865] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:07 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:07.491940 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:07.493227 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:07.500252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:07.500847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:07.501726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:07.502274 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:07.686384 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:07.702486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7c8045dd-0cab-4fd7-9e16-50d752bd6c25 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.213998 Jul 28 01:21:07.714865 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 419/866] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:07 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:08.252027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:08.252770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:08.260967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.261444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.262223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.262660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.392756 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:08.400591 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9a3c3b0c-ceb4-4575-b800-554a5b5a602a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.152461 Jul 28 01:21:08.401171 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 448/867] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:08 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:08.664108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e05e2f06-6693-4552-8200-6532d55f2b03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:08.666398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e05e2f06-6693-4552-8200-6532d55f2b03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:08.673721 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e05e2f06-6693-4552-8200-6532d55f2b03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.673885 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e05e2f06-6693-4552-8200-6532d55f2b03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.674623 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e05e2f06-6693-4552-8200-6532d55f2b03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.675848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e05e2f06-6693-4552-8200-6532d55f2b03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.700322 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-5f992878-5e03-47ae-8f78-c9c1d0ec9fc6 req-bba20c1b-9093-458e-a10e-094f6110d070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b4c04e-6092-46be-81eb-ba1875da7604", "tag": "2fac2c95-cf02-4ee0-ad0c-4bd68363a281"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:08.713103 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e05e2f06-6693-4552-8200-6532d55f2b03 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052041 Jul 28 01:21:08.714958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 420/868] 10.222.0.17 () {60 vars in 1343 bytes} [Thu Jul 28 01:21:08 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:08.715341 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5f992878-5e03-47ae-8f78-c9c1d0ec9fc6 req-bba20c1b-9093-458e-a10e-094f6110d070 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.715795 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5f992878-5e03-47ae-8f78-c9c1d0ec9fc6 req-bba20c1b-9093-458e-a10e-094f6110d070 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.727291 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:08.729009 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:08.737206 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.737406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-5f992878-5e03-47ae-8f78-c9c1d0ec9fc6 req-bba20c1b-9093-458e-a10e-094f6110d070 service nova] Creating event network-changed:2fac2c95-cf02-4ee0-ad0c-4bd68363a281 for instance b3b4c04e-6092-46be-81eb-ba1875da7604 on hv-cinder-81558 Jul 28 01:21:08.738090 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.739135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.739765 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.744166 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-5f992878-5e03-47ae-8f78-c9c1d0ec9fc6 req-bba20c1b-9093-458e-a10e-094f6110d070 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049867 Jul 28 01:21:08.746474 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 449/869] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:08.785003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:08.786119 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:08.798770 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.799251 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.800102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.801305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.820220 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:08.843803 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:21:08.899415 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:08.908293 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-08b1cdba-2aaa-4903-a04a-67ecb4d4e2a4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.185780 Jul 28 01:21:08.908819 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 421/870] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:08 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:08.940165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a69c8ed2-5b44-4291-bcc0-39d76f872ee9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 204 len: 0 microversion: 2.20 time: 0.159845 Jul 28 01:21:08.940994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 450/871] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Jul 28 01:21:08 2022] DELETE /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 01:21:08.949999 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:08.950552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:08.956879 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.957265 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:08.958054 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:08.958579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:09.099709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:09.108687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:09.110336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:09.111582 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6bfeda14-0261-4873-917a-d109c088fade tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.165715 Jul 28 01:21:09.112141 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 422/872] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:21:08 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:21:09.422508 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:09.423376 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:09.430158 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:09.430607 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:09.431413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:09.431849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:09.572498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:09.580690 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-95a1131f-cc4c-485b-8af5-4916cfeb2e16 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.162555 Jul 28 01:21:09.581238 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 451/873] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:09 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:09.930323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:09.930957 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:09.939389 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:09.939837 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:09.940732 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:09.941233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:10.090146 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:10.098267 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b1e550f4-9eb2-4612-af9d-00eaddded0ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.171944 Jul 28 01:21:10.098721 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 423/874] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:09 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:10.140576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:10.141192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:10.147980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:10.148433 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:10.149286 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:10.149857 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:10.294375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:10.303102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:10.304723 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:10.306002 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ed64caab-2d5c-44ba-b3cf-f36f69daabc4 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.171099 Jul 28 01:21:10.306618 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 452/875] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:21:10 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:21:10.601548 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:10.602171 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:10.608119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:10.608665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:10.609442 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:10.609870 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:10.748236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:10.756832 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e7ad825d-2523-4c5b-a054-7f706e9bd315 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.159093 Jul 28 01:21:10.757404 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 424/876] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:10 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:11.125567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:11.127399 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:11.135747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:11.136684 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:11.137680 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:11.139200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:11.330590 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:11.331340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:11.342045 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:11.342502 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:11.346980 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:11.347657 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:11.372955 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=100 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:11.692499 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:11.704844 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e73c7320-ce93-48b1-a7f6-9a14997175ad tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.583690 Jul 28 01:21:11.707453 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 453/877] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:11 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:11.784585 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:11.785383 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:11.796015 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:11.797020 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:11.798082 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:11.798795 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:11.836177 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:11.845118 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:11.846628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:11.847918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7e995556-2176-4e2b-be38-ac0391fbe2e9 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1723 microversion: 2.20 time: 0.522066 Jul 28 01:21:11.848412 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 425/878] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:21:11 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1723 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 01:21:12.056010 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:12.068025 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-080fb3a6-3fe2-4d03-a032-899d9529c4c7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.293050 Jul 28 01:21:12.069517 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 454/879] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:11 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:12.519994 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-499dc16b-6518-4335-9ae0-7a23c53a4f59 req-88762547-09fe-4e77-86cd-c588f7cf7a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035e590-ae9f-4fb3-ac7f-3615a1ce992c", "name": "network-vif-deleted", "tag": "bd4676aa-4815-4dd2-8cfe-5bab28819f71"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:12.530424 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-499dc16b-6518-4335-9ae0-7a23c53a4f59 req-88762547-09fe-4e77-86cd-c588f7cf7a24 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:12.530899 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-499dc16b-6518-4335-9ae0-7a23c53a4f59 req-88762547-09fe-4e77-86cd-c588f7cf7a24 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:12.542625 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-499dc16b-6518-4335-9ae0-7a23c53a4f59 req-88762547-09fe-4e77-86cd-c588f7cf7a24 service nova] Creating event network-vif-deleted:bd4676aa-4815-4dd2-8cfe-5bab28819f71 for instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c on hv-cinder-81558 Jul 28 01:21:12.548139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-499dc16b-6518-4335-9ae0-7a23c53a4f59 req-88762547-09fe-4e77-86cd-c588f7cf7a24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031787 Jul 28 01:21:12.551801 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 426/880] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:12.731855 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:12.732856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:12.740854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:12.741514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:12.742650 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:12.743219 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:12.872266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:12.873243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:12.889174 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:12.892162 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:12.892996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:12.893429 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:12.896679 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:12.904640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2c1e5b51-a714-4fbc-b6c0-1ee79818ad9e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.180299 Jul 28 01:21:12.910895 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 455/881] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:12 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:12.927681 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:12.928180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:12.928582 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lazy-loading 'fault' on Instance uuid b035e590-ae9f-4fb3-ac7f-3615a1ce992c {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:21:12.972531 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:12.981675 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:12.984693 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '166cef282cb24a5aaef0ca8b28f02e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3df8020ac0427bae99a7fc30bdfa48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:12.986092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c7c1bb92-f879-45cb-89ac-3bc6ef67c71a tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 200 len: 1370 microversion: 2.20 time: 0.118207 Jul 28 01:21:12.987236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 427/882] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:21:12 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 1370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 01:21:13.089364 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:13.091525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:13.096728 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:13.097180 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:13.097954 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:13.098378 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:13.248669 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:13.261027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a84e2e7-47fb-4bae-bd29-6fc32e482f85 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.175575 Jul 28 01:21:13.263899 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 456/883] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:13 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:13.466668 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-8870a7d8-6d5c-44bb-b17f-596e076e42ef req-e0a37109-aae6-4dbf-9524-581ce01dc079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183b3616-c163-4cad-a062-6d0637e9d642", "name": "network-vif-plugged", "status": "completed", "tag": "79e0f07f-163d-476a-bcb0-0be5f3ea5eff"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:13.484667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8870a7d8-6d5c-44bb-b17f-596e076e42ef req-e0a37109-aae6-4dbf-9524-581ce01dc079 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:13.485058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8870a7d8-6d5c-44bb-b17f-596e076e42ef req-e0a37109-aae6-4dbf-9524-581ce01dc079 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:13.497025 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-8870a7d8-6d5c-44bb-b17f-596e076e42ef req-e0a37109-aae6-4dbf-9524-581ce01dc079 service nova] Creating event network-vif-plugged:79e0f07f-163d-476a-bcb0-0be5f3ea5eff for instance 183b3616-c163-4cad-a062-6d0637e9d642 on hv-cinder-81558 Jul 28 01:21:13.502142 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-8870a7d8-6d5c-44bb-b17f-596e076e42ef req-e0a37109-aae6-4dbf-9524-581ce01dc079 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039435 Jul 28 01:21:13.502779 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 428/884] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:13.925449 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:13.926204 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:13.933225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:13.933672 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:13.934446 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:13.934907 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:14.011365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:14.011927 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:14.018809 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:14.019285 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:14.020047 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:14.020472 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:14.035040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] HTTP exception thrown: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Request method failure captured: Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c HTTP/1.1 Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLS006mcG-AuhXZB6dP_YOQnqYmiuPJrAve8SGb53BZ63wLP6I7ZOfFuhKMwIYFuUOXSte-Nib9jiXGUi-VBVJhwnno5C-YX-xuo4G-xIAl4vxS3wW4gxWqD23EdWN_wdg3R8uAYMbz3sABtQCulElNNiQjA-S2YHbV53btgKfDknk Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:21:14.036703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e3df8020ac0427bae99a7fc30bdfa48", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 166cef282cb24a5aaef0ca8b28f02e56 Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:14.038313 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'b035e590-ae9f-4fb3-ac7f-3615a1ce992c'} Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:21:14.039290 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:14.040789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:14.042479 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Returning 404 to user: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:21:14.042479 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-00208cb0-3e56-4cfc-8260-d8ede0965440 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 404 len: 111 microversion: 2.20 time: 0.031716 Jul 28 01:21:14.042479 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 429/885] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:21:14 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:21:14.046935 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fea24d3b-ec74-4d6e-b6bf-2870131f2e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '.version_select at 0x7ff71c621820>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:14.067870 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fea24d3b-ec74-4d6e-b6bf-2870131f2e7c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-312006518" status: 204 len: 0 microversion: 2.20 time: 0.024595 Jul 28 01:21:14.068440 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 430/886] 10.222.0.17 () {60 vars in 1259 bytes} [Thu Jul 28 01:21:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-312006518 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 01:21:14.077552 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:14.093055 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6f476ebe-3e58-4034-94d4-b42ca004a7b4 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1575 microversion: 2.1 time: 0.171426 Jul 28 01:21:14.093714 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 457/887] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:13 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:14.282243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:14.282893 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:14.291672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:14.292214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:14.293142 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:14.293694 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:14.525381 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:14.536409 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8b54ed3f-ed67-4ac3-946c-3422fcfdd76a tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.257149 Jul 28 01:21:14.537239 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 431/888] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:14 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:15.115870 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:15.116545 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:15.127510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.127510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.127510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.127510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.264278 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:15.273073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e22536f9-d4cf-41d2-93d8-4cf2ce785806 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1562 microversion: 2.1 time: 0.161785 Jul 28 01:21:15.273743 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 458/889] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:15 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:15.533851 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-858388f1-33cb-4794-808a-4b9fcc765c50 req-dd4db66a-b930-42ab-8a81-0fc73bfa9386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b4c04e-6092-46be-81eb-ba1875da7604", "name": "network-vif-plugged", "status": "completed", "tag": "2fac2c95-cf02-4ee0-ad0c-4bd68363a281"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:15.548315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-858388f1-33cb-4794-808a-4b9fcc765c50 req-dd4db66a-b930-42ab-8a81-0fc73bfa9386 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.548800 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-858388f1-33cb-4794-808a-4b9fcc765c50 req-dd4db66a-b930-42ab-8a81-0fc73bfa9386 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.557539 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:15.558275 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:15.561048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-858388f1-33cb-4794-808a-4b9fcc765c50 req-dd4db66a-b930-42ab-8a81-0fc73bfa9386 service nova] Creating event network-vif-plugged:2fac2c95-cf02-4ee0-ad0c-4bd68363a281 for instance b3b4c04e-6092-46be-81eb-ba1875da7604 on hv-cinder-81558 Jul 28 01:21:15.565506 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.565950 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.566204 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-858388f1-33cb-4794-808a-4b9fcc765c50 req-dd4db66a-b930-42ab-8a81-0fc73bfa9386 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036687 Jul 28 01:21:15.566716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.566965 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 432/890] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:15.567348 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.759613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:15.767736 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1bc2386e-4243-4429-9b1a-89f9333216f0 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.213970 Jul 28 01:21:15.768356 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 459/891] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:15 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:15.940964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:15.941744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:15.946429 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:15.947058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:15.954484 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.954973 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.955740 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.956182 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.970294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] HTTP exception thrown: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Request method failure captured: Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: DELETE /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c HTTP/1.1 Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLS006mcG-AuhXZB6dP_YOQnqYmiuPJrAve8SGb53BZ63wLP6I7ZOfFuhKMwIYFuUOXSte-Nib9jiXGUi-VBVJhwnno5C-YX-xuo4G-xIAl4vxS3wW4gxWqD23EdWN_wdg3R8uAYMbz3sABtQCulElNNiQjA-S2YHbV53btgKfDknk Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:21:15.972018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e3df8020ac0427bae99a7fc30bdfa48", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 166cef282cb24a5aaef0ca8b28f02e56 Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:15.973620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'b035e590-ae9f-4fb3-ac7f-3615a1ce992c'} Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:21:15.974696 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:15.976199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:15.977821 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Returning 404 to user: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:21:15.977821 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5475264c-f084-45b0-aa7c-867e44296b1d tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 404 len: 111 microversion: 2.20 time: 0.033441 Jul 28 01:21:15.977821 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 433/892] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Jul 28 01:21:15 2022] DELETE /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:21:15.982360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:15.982998 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: b035e590-ae9f-4fb3-ac7f-3615a1ce992c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:15.989339 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.989794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:15.990556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:15.991019 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:16.004594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] HTTP exception thrown: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Request method failure captured: Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c HTTP/1.1 Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLS006mcG-AuhXZB6dP_YOQnqYmiuPJrAve8SGb53BZ63wLP6I7ZOfFuhKMwIYFuUOXSte-Nib9jiXGUi-VBVJhwnno5C-YX-xuo4G-xIAl4vxS3wW4gxWqD23EdWN_wdg3R8uAYMbz3sABtQCulElNNiQjA-S2YHbV53btgKfDknk Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:21:16.006614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e3df8020ac0427bae99a7fc30bdfa48", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 166cef282cb24a5aaef0ca8b28f02e56 Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:16.008295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'b035e590-ae9f-4fb3-ac7f-3615a1ce992c'} Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:21:16.009396 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. Jul 28 01:21:16.010959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:16.012434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Returning 404 to user: Instance b035e590-ae9f-4fb3-ac7f-3615a1ce992c could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:21:16.012434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c5db901d-6be8-4ea1-9c49-bc8b6c629f2c tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c" status: 404 len: 111 microversion: 2.20 time: 0.029721 Jul 28 01:21:16.012434 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 460/893] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:21:15 2022] GET /compute/v2.1/servers/b035e590-ae9f-4fb3-ac7f-3615a1ce992c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:21:16.788419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:16.789059 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:16.796523 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:16.796990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:16.797799 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:16.798258 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:16.934325 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:16.942574 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9d26e7f8-d6a1-4467-a3bf-3ee9c7551951 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1319 microversion: 2.1 time: 0.158078 Jul 28 01:21:16.943246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 434/894] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:16 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:17.151614 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:17.152170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:17.154156 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:17.162757 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:17.163577 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:17.164710 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:17.165168 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:17.181256 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] HTTP exception thrown: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Request method failure captured: Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b HTTP/1.1 Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eLS006mcG-AuhXZB6dP_YOQnqYmiuPJrAve8SGb53BZ63wLP6I7ZOfFuhKMwIYFuUOXSte-Nib9jiXGUi-VBVJhwnno5C-YX-xuo4G-xIAl4vxS3wW4gxWqD23EdWN_wdg3R8uAYMbz3sABtQCulElNNiQjA-S2YHbV53btgKfDknk Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:21:17.183154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e3df8020ac0427bae99a7fc30bdfa48", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 166cef282cb24a5aaef0ca8b28f02e56 Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.184603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '300e3c0c-fb14-4c05-b53a-fe8f0589ac1b'} Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:21:17.185326 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.186507 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.187793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Returning 404 to user: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:21:17.187793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-74e9c64c-badf-4d2e-9253-76a13b67305b tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "DELETE /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 404 len: 111 microversion: 2.20 time: 0.037167 Jul 28 01:21:17.187793 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 461/895] 10.222.0.17 () {60 vars in 1280 bytes} [Thu Jul 28 01:21:17 2022] DELETE /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:21:17.193573 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:17.194163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] [instance: 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:17.201027 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:17.201478 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:17.202253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:17.202903 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:17.217365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] HTTP exception thrown: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Request method failure captured: Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b HTTP/1.1 Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eLS006mcG-AuhXZB6dP_YOQnqYmiuPJrAve8SGb53BZ63wLP6I7ZOfFuhKMwIYFuUOXSte-Nib9jiXGUi-VBVJhwnno5C-YX-xuo4G-xIAl4vxS3wW4gxWqD23EdWN_wdg3R8uAYMbz3sABtQCulElNNiQjA-S2YHbV53btgKfDknk Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:21:17.219585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6e3df8020ac0427bae99a7fc30bdfa48", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6e3df8020ac0427bae99a7fc30bdfa48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: 6e3df8020ac0427bae99a7fc30bdfa48 Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123147080 Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 166cef282cb24a5aaef0ca8b28f02e56 Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123147080-project Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.221315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '300e3c0c-fb14-4c05-b53a-fe8f0589ac1b'} Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:21:17.222158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. Jul 28 01:21:17.223667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:21:17.224971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] Returning 404 to user: Instance 300e3c0c-fb14-4c05-b53a-fe8f0589ac1b could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:21:17.224971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9cdebca2-195a-49aa-b877-d7c9c8588fe8 tempest-AttachVolumeShelveTestJSON-2123147080 tempest-AttachVolumeShelveTestJSON-2123147080-project] 10.222.0.17 "GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b" status: 404 len: 111 microversion: 2.20 time: 0.031428 Jul 28 01:21:17.224971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 435/896] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jul 28 01:21:17 2022] GET /compute/v2.1/servers/300e3c0c-fb14-4c05-b53a-fe8f0589ac1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:21:17.963785 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:17.964404 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:17.970976 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:17.971438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:17.972206 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:17.972641 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:18.112719 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:18.120637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5369d7d8-ca19-4e0d-a11c-224ae81ec8c1 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1507 microversion: 2.1 time: 0.160811 Jul 28 01:21:18.121209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 462/897] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:17 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:18.141726 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-29361690-9d94-4461-a5d8-428e927adcf7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2122834b-9c15-429b-874a-19b43dd4da14", "device": "/dev/sdb"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:18.146764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-29361690-9d94-4461-a5d8-428e927adcf7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:18.153708 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-29361690-9d94-4461-a5d8-428e927adcf7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:18.154149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-29361690-9d94-4461-a5d8-428e927adcf7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:18.154950 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-29361690-9d94-4461-a5d8-428e927adcf7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:18.155542 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-29361690-9d94-4461-a5d8-428e927adcf7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:18.497720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-29361690-9d94-4461-a5d8-428e927adcf7 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "POST /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359519 Jul 28 01:21:18.498604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 436/898] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:21:18 2022] POST /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:26.851823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3c3e5f3-8da1-4f11-bffb-cb236507312c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: .version_select at 0x7ff71c3dc550>, body: {"keypair": {"name": "tempest-keypair-1473836575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKODXTybJZshfPPnhmhCxk2FC8FpkAxvPigBERZD/j1uve3bybUHlYGfzR7f3eZ9934d2qnuuMA7SAuRcvlX7iKrurUx7ZrR8ghG+BfMymNpxOxD0PbGUIRMvk6tVnXJg=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:26.868066 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-b3c3e5f3-8da1-4f11-bffb-cb236507312c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:21:26.872309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-b3c3e5f3-8da1-4f11-bffb-cb236507312c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:21:26.897077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b3c3e5f3-8da1-4f11-bffb-cb236507312c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196612 Jul 28 01:21:26.897624 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 463/899] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:21:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:28.246369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1498390069", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bac661c0-9620-4ebf-b1dc-5201ea1d9315"}], "security_groups": [{"name": "tempest-securitygroup--1531411736"}], "key_name": "tempest-keypair-1473836575", "user_data": "}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:28.255665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:28.362060 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] validate_networks() for [('bac661c0-9620-4ebf-b1dc-5201ea1d9315', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:21:28.480918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:28.879420 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:21:28.880193 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:21:28.880661 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:21:28.881245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:21:28.881672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:21:28.890721 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:28.891428 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:28.892448 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:28.893061 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:28.911982 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:21:28.916635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:21:28.928408 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:21:28.930809 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:21:28.978057 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-91feb601-339b-4b80-840e-a2162e921fa5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736288 Jul 28 01:21:28.978614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 437/900] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:21:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:21:28.990267 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-983beee7-24ea-454c-9c7c-063b1ffeb2bb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:28.991631 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-983beee7-24ea-454c-9c7c-063b1ffeb2bb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:28.995191 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:29.061978 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-983beee7-24ea-454c-9c7c-063b1ffeb2bb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:29.069934 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-983beee7-24ea-454c-9c7c-063b1ffeb2bb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1242 microversion: 2.1 time: 0.084018 Jul 28 01:21:29.070599 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 464/901] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:28 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:30.091998 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:30.092695 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:30.100010 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:30.101232 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:30.102243 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:30.102946 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:30.175777 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:30.184139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f7ca9745-c5bd-4e63-b533-6382bfb146e5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1246 microversion: 2.1 time: 0.096524 Jul 28 01:21:30.199163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 438/902] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:30 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1246 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:31.206225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:31.207546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:31.210720 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:31.216430 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:31.216965 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:31.217845 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:31.218344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:31.281901 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:31.289484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8025ca28-11b8-4648-a3e7-c72563c1adf8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1238 microversion: 2.1 time: 0.087248 Jul 28 01:21:31.290028 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 465/903] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:31 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:32.311675 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:32.312283 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:32.319394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:32.319954 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:32.320588 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:32.321178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:32.385394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:32.393011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e1eeffa9-9c7e-41f7-b239-f1d25da62a90 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1302 microversion: 2.1 time: 0.085267 Jul 28 01:21:32.394390 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 439/904] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:32 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:21:33.417427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:33.418246 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:33.427814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:33.428355 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:33.429241 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:33.429823 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:33.495755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:33.503596 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1684044d-3095-465b-ac6f-45aa3620f125 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1302 microversion: 2.1 time: 0.092415 Jul 28 01:21:33.504164 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 466/905] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:33 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:34.528847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:34.529578 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:34.539922 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:34.540471 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:34.541530 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:34.542114 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:34.618970 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:34.630261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5058a078-a794-449a-a4c3-a95a3087d71c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1302 microversion: 2.1 time: 0.107133 Jul 28 01:21:34.631124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 440/906] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:34 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:35.655838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:35.656565 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:35.663794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:35.664662 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:35.665551 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:35.665985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:35.863377 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:35.874097 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4c053298-0728-4d0b-8635-e5888b06b7c1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.222129 Jul 28 01:21:35.888629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 467/907] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:35 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:36.270801 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-cca448e5-e2f0-47b3-90d6-e2b86814907d req-b7873c2a-09f3-40dd-b5f9-18bd61558549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5671e0a-fdd0-4692-93aa-4ff5ef293562", "tag": "0f4b842e-8b20-44f6-b3fc-362c3ed518c8"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:36.289232 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-cca448e5-e2f0-47b3-90d6-e2b86814907d req-b7873c2a-09f3-40dd-b5f9-18bd61558549 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:36.290360 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-cca448e5-e2f0-47b3-90d6-e2b86814907d req-b7873c2a-09f3-40dd-b5f9-18bd61558549 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:36.305270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-cca448e5-e2f0-47b3-90d6-e2b86814907d req-b7873c2a-09f3-40dd-b5f9-18bd61558549 service nova] Creating event network-changed:0f4b842e-8b20-44f6-b3fc-362c3ed518c8 for instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 on hv-cinder-81558 Jul 28 01:21:36.310977 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-cca448e5-e2f0-47b3-90d6-e2b86814907d req-b7873c2a-09f3-40dd-b5f9-18bd61558549 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044849 Jul 28 01:21:36.312362 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 441/908] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:36.898592 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:36.899484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:36.908641 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:36.909250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:36.910278 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:36.910884 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:37.059162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:37.067594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-45909147-677c-4c66-9b79-6f85715178e4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.174227 Jul 28 01:21:37.068179 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 468/909] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:36 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:38.094414 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:38.096179 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:38.103809 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:38.104254 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:38.105017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:38.105470 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:38.250642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:38.262896 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e253354b-e22c-447e-9e36-f7c83462f94f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.173111 Jul 28 01:21:38.263776 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 442/910] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:38 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:39.284849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:39.285406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:39.287794 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:39.293578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:39.294022 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:39.294927 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:39.295510 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:39.442333 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:39.450116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-160cc2fb-f088-449f-bb3c-c46d502221a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.169296 Jul 28 01:21:39.450695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 469/911] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:39 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:40.472237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:40.472842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:40.474962 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:40.475651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:40.482035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:40.482501 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:40.491792 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:40.492446 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:40.630620 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:40.638651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-5307afa6-9196-4b62-b354-645acc7365b0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.170571 Jul 28 01:21:40.639271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 443/912] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:40 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:40.947984 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905363895", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-388651129", "security_groups": [{"name": "tempest-secgroup-smoke-1741610070"}], "block_device_mapping_v2": [{"uuid": "a6c4987f-ab1b-4e72-92e2-fa04bd041305", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f365ac42-75a7-4c3d-8591-d4097c9f6065"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:41.068509 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] validate_networks() for [('f365ac42-75a7-4c3d-8591-d4097c9f6065', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:21:41.665207 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:41.666100 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:41.673558 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:41.674136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:41.674980 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:41.675412 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:41.713227 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:21:41.713649 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:21:41.714144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:21:41.714573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:21:41.715031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:21:41.725259 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:41.725706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:41.726538 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:41.727008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:41.743516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for project d14de33f76ea44db8899900481299b87. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:21:41.747696 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Getting quotas for user d9cb42db2f9a4b80b17bef0a86945a6c and project d14de33f76ea44db8899900481299b87. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:21:41.806302 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:21:41.808441 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6c4987f-ab1b-4e72-92e2-fa04bd041305',volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:21:41.884968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:41.898677 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8b4ebe24-d3a4-4b3a-8ab2-79fc53436bb7 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.233800 Jul 28 01:21:41.899370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 444/913] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:41 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:41.940881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4b8c4cbd-e4c0-4771-9177-dc958810d98d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.996734 Jul 28 01:21:41.941438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 470/914] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:21:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:21:41.952587 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-56aa5d11-c2af-4505-b5a4-0dbf8b59cf08 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:41.953245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-56aa5d11-c2af-4505-b5a4-0dbf8b59cf08 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:42.006577 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-56aa5d11-c2af-4505-b5a4-0dbf8b59cf08 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:42.013388 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-56aa5d11-c2af-4505-b5a4-0dbf8b59cf08 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1094 microversion: 2.1 time: 0.064766 Jul 28 01:21:42.014998 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 445/915] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:41 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:42.349629 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:42.350157 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:42.357503 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:42.358000 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:42.358866 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:42.359656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:42.461181 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lazy-loading 'services' on Instance uuid b3b4c04e-6092-46be-81eb-ba1875da7604 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:21:42.558570 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b1b232dc-dab3-4ea0-8b94-2236cffdc337 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604/os-volume_attachments/2122834b-9c15-429b-874a-19b43dd4da14" status: 202 len: 0 microversion: 2.1 time: 0.215654 Jul 28 01:21:42.559375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 471/916] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:21:42 2022] DELETE /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604/os-volume_attachments/2122834b-9c15-429b-874a-19b43dd4da14 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:21:42.923210 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:42.923831 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:42.934058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:42.934513 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:42.935353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:42.935842 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:43.035970 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:43.036952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:43.045022 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:43.045464 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:43.046233 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:43.046657 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:43.076931 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:43.085254 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-cccdf805-2586-4179-9b90-ec88e6382dbd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.168441 Jul 28 01:21:43.085701 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 446/917] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:42 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:43.111183 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:43.119620 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-199bc43e-a18d-42e7-9a10-a1bd4af02968 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1192 microversion: 2.1 time: 0.088293 Jul 28 01:21:43.120201 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 472/918] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:43 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:43.770049 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:43.770855 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:43.778887 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:43.779522 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:43.780302 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:43.780732 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:43.851153 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:21:43.987351 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7b297302-eb2e-4ae6-b535-d2cb478da834 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 204 len: 0 microversion: 2.1 time: 0.221290 Jul 28 01:21:43.988316 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 447/919] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:21:43 2022] DELETE /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:21:43.998483 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:43.999143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:44.011095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:44.011516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:44.012854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:44.013408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:44.111614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:44.113320 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:44.122830 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:44.123367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:44.124173 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:44.124782 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:44.287647 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:44.307258 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e01c5c32-38db-427c-8759-eb7183531444 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1513 microversion: 2.1 time: 0.313615 Jul 28 01:21:44.308980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 473/920] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:43 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:44.326644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:44.327356 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:44.338630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:44.339389 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:44.340392 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:44.341035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:44.352465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:44.361447 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8545e385-8897-4b49-8ad6-2e1957fd6597 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.256419 Jul 28 01:21:44.363517 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 448/921] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:44 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:44.560549 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:44.570096 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2224f104-159c-4439-aa65-ac9912d34f2d tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1278 microversion: 2.1 time: 0.258989 Jul 28 01:21:44.570761 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 474/922] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:44 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:45.337803 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:45.338399 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:45.345323 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:45.345658 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:45.346519 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:45.346994 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:45.410546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:45.411201 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:45.435915 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:45.436367 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:45.451301 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:45.451973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:45.497252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:45.507808 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-51c8e030-e154-4c93-9148-834ff28d31b3 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1513 microversion: 2.1 time: 0.174135 Jul 28 01:21:45.508401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 449/923] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:45 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:45.561030 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-bb8d95dd-7b02-417d-8009-a313968382fc req-f5368781-97a7-4bee-95e8-35a8c72bc475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5671e0a-fdd0-4692-93aa-4ff5ef293562", "name": "network-vif-plugged", "status": "completed", "tag": "0f4b842e-8b20-44f6-b3fc-362c3ed518c8"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:45.575270 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-bb8d95dd-7b02-417d-8009-a313968382fc req-f5368781-97a7-4bee-95e8-35a8c72bc475 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:45.582822 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-bb8d95dd-7b02-417d-8009-a313968382fc req-f5368781-97a7-4bee-95e8-35a8c72bc475 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:45.607738 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-bb8d95dd-7b02-417d-8009-a313968382fc req-f5368781-97a7-4bee-95e8-35a8c72bc475 service nova] Creating event network-vif-plugged:0f4b842e-8b20-44f6-b3fc-362c3ed518c8 for instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 on hv-cinder-81558 Jul 28 01:21:45.620150 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-bb8d95dd-7b02-417d-8009-a313968382fc req-f5368781-97a7-4bee-95e8-35a8c72bc475 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065989 Jul 28 01:21:45.622004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 450/924] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:21:45.629001 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:45.630422 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:45.638016 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:45.638562 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:45.639455 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:45.639961 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:45.699003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:45.709164 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b751a007-1aaa-42b9-a95f-10d81423f2de tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.324599 Jul 28 01:21:45.710398 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 475/925] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:45 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:45.894611 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:45.906872 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-948ef3f7-16f8-421a-9058-54adf0e8a422 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1278 microversion: 2.1 time: 0.281332 Jul 28 01:21:45.908420 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 451/926] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:45 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:46.259609 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-56c2e37e-7598-474b-b8d0-426cfe8eba90 req-0f09bcde-ed74-4b60-b311-db53b20b14af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cb86c7-bffa-49d1-abf4-1973ff6e3d47", "tag": "5d38e46e-4f07-4410-82fe-f06a06925de2"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:46.276215 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-56c2e37e-7598-474b-b8d0-426cfe8eba90 req-0f09bcde-ed74-4b60-b311-db53b20b14af service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.276886 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-56c2e37e-7598-474b-b8d0-426cfe8eba90 req-0f09bcde-ed74-4b60-b311-db53b20b14af service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:46.291621 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-56c2e37e-7598-474b-b8d0-426cfe8eba90 req-0f09bcde-ed74-4b60-b311-db53b20b14af service nova] Creating event network-changed:5d38e46e-4f07-4410-82fe-f06a06925de2 for instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 on hv-cinder-81558 Jul 28 01:21:46.297579 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-56c2e37e-7598-474b-b8d0-426cfe8eba90 req-0f09bcde-ed74-4b60-b311-db53b20b14af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042520 Jul 28 01:21:46.301779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 476/927] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:46.369706 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-d3534b48-a7e4-4fae-8e50-8ec8df2fddd7 req-ca31b969-d6c4-47a9-92eb-66c14a5c4974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b4c04e-6092-46be-81eb-ba1875da7604", "name": "network-vif-deleted", "tag": "2fac2c95-cf02-4ee0-ad0c-4bd68363a281"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:46.387356 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d3534b48-a7e4-4fae-8e50-8ec8df2fddd7 req-ca31b969-d6c4-47a9-92eb-66c14a5c4974 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.388913 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d3534b48-a7e4-4fae-8e50-8ec8df2fddd7 req-ca31b969-d6c4-47a9-92eb-66c14a5c4974 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:46.413910 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-d3534b48-a7e4-4fae-8e50-8ec8df2fddd7 req-ca31b969-d6c4-47a9-92eb-66c14a5c4974 service nova] Creating event network-vif-deleted:2fac2c95-cf02-4ee0-ad0c-4bd68363a281 for instance b3b4c04e-6092-46be-81eb-ba1875da7604 on hv-cinder-81558 Jul 28 01:21:46.419115 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-d3534b48-a7e4-4fae-8e50-8ec8df2fddd7 req-ca31b969-d6c4-47a9-92eb-66c14a5c4974 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053119 Jul 28 01:21:46.419969 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 452/928] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:46.530114 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:46.530814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:46.537639 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.538066 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:46.538857 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.539298 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:46.603603 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:46.612976 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-70f899a0-9be2-483a-96de-845f9de60e14 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1304 microversion: 2.1 time: 0.087538 Jul 28 01:21:46.613525 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 477/929] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:46 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:46.730468 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:46.731554 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:46.738708 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.739467 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:46.740164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.740652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:46.892491 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:46.900764 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6497f3a6-f2a9-4a34-84e8-aff910732254 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1368 microversion: 2.1 time: 0.174693 Jul 28 01:21:46.901550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 453/930] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:46 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:46.928026 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:46.928632 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:46.934716 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.935194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:46.935949 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:46.936375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:47.071103 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:47.079486 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1dc42b9c-e62f-4031-beaa-22448db80c70 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.155243 Jul 28 01:21:47.080343 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 478/931] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:46 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:47.634821 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:47.635459 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:47.642591 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:47.643388 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:47.644244 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:47.644667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:47.681636 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:47.682082 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:47.682536 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lazy-loading 'fault' on Instance uuid b3b4c04e-6092-46be-81eb-ba1875da7604 {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:21:47.734250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a7db7a0f544b3eb9487bf00adbb742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8840b41dd8364a8a976f04d4fe421b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:47.742295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4d6ce8ce-c912-45f9-a125-37aab73e9c41 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 200 len: 1309 microversion: 2.1 time: 0.112374 Jul 28 01:21:47.742963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 454/932] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:47 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:47.922112 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:47.923232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:47.930384 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:47.931003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:47.931899 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:47.932587 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:48.081523 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:48.089242 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1458927e-817b-4214-9cfd-ca8880cc6f63 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1557 microversion: 2.1 time: 0.171332 Jul 28 01:21:48.089814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 479/933] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:47 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:48.101033 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:48.101654 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:48.108199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:48.108648 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:48.109456 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:48.109895 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:48.111360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e75ed568-15a3-4e24-986a-fe7c4968bd0f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:48.111847 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e75ed568-15a3-4e24-986a-fe7c4968bd0f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:48.115333 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:48.118483 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e75ed568-15a3-4e24-986a-fe7c4968bd0f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:48.119108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e75ed568-15a3-4e24-986a-fe7c4968bd0f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:48.119878 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e75ed568-15a3-4e24-986a-fe7c4968bd0f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:48.120533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e75ed568-15a3-4e24-986a-fe7c4968bd0f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:48.234539 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e75ed568-15a3-4e24-986a-fe7c4968bd0f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127729 Jul 28 01:21:48.235548 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 480/934] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:21:48 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:48.358280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:48.367189 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2eadbe6f-1b33-4c51-82fb-e92d71b46deb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.269414 Jul 28 01:21:48.367189 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 455/935] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:48 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:48.766989 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:48.767747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] [instance: b3b4c04e-6092-46be-81eb-ba1875da7604] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:48.774232 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:48.774700 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:48.775701 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:48.776137 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:48.791586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] HTTP exception thrown: Instance b3b4c04e-6092-46be-81eb-ba1875da7604 could not be found. Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Request method failure captured: Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 HTTP/1.1 Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eQ72SHeAwrl4l1Qm4j4MAEwew8euQBO8w0i89yXmGSdTR66I85PA-R78FwpSRkx2d91SQRsbL6BS-51JuzRo9SQT7bPIbio7WI8YvyCo-Q8_Kt935zBgAT7fA4RMBiZnkoi6cA3AqVvhfb01xY9TJAC2LHAXNbTLACUZVYz3iMLxG0 Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: 8840b41dd8364a8a976f04d4fe421b8e Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1780863891 Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:21:48.793239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8840b41dd8364a8a976f04d4fe421b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8840b41dd8364a8a976f04d4fe421b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8840b41dd8364a8a976f04d4fe421b8e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8840b41dd8364a8a976f04d4fe421b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotTestJSON-1780863891 Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 8840b41dd8364a8a976f04d4fe421b8e Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1780863891 Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotTestJSON-1780863891-project Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 82a7db7a0f544b3eb9487bf00adbb742 Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotTestJSON-1780863891-project Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance b3b4c04e-6092-46be-81eb-ba1875da7604 could not be found. Jul 28 01:21:48.794993 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'b3b4c04e-6092-46be-81eb-ba1875da7604'} Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3b4c04e-6092-46be-81eb-ba1875da7604 could not be found. Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:21:48.795849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3b4c04e-6092-46be-81eb-ba1875da7604 could not be found. Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3b4c04e-6092-46be-81eb-ba1875da7604 could not be found. Jul 28 01:21:48.797406 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:21:48.798888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] Returning 404 to user: Instance b3b4c04e-6092-46be-81eb-ba1875da7604 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:21:48.798888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82d9acf9-5a1e-472f-9b4a-6d617cb8d6f9 tempest-VolumesSnapshotTestJSON-1780863891 tempest-VolumesSnapshotTestJSON-1780863891-project] 10.222.0.17 "GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604" status: 404 len: 111 microversion: 2.1 time: 0.033982 Jul 28 01:21:48.798888 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 481/936] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:48 2022] GET /compute/v2.1/servers/b3b4c04e-6092-46be-81eb-ba1875da7604 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:21:49.255407 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-748dc900-b653-4905-8dfc-e58c3a443969 req-fcadddb2-2f77-440c-b6d6-22398d4bb76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5671e0a-fdd0-4692-93aa-4ff5ef293562", "tag": "0f4b842e-8b20-44f6-b3fc-362c3ed518c8"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:49.265686 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-748dc900-b653-4905-8dfc-e58c3a443969 req-fcadddb2-2f77-440c-b6d6-22398d4bb76f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:49.266134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-748dc900-b653-4905-8dfc-e58c3a443969 req-fcadddb2-2f77-440c-b6d6-22398d4bb76f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:49.278383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-748dc900-b653-4905-8dfc-e58c3a443969 req-fcadddb2-2f77-440c-b6d6-22398d4bb76f service nova] Creating event network-changed:0f4b842e-8b20-44f6-b3fc-362c3ed518c8 for instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 on hv-cinder-81558 Jul 28 01:21:49.283480 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-748dc900-b653-4905-8dfc-e58c3a443969 req-fcadddb2-2f77-440c-b6d6-22398d4bb76f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032151 Jul 28 01:21:49.284110 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 456/937] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:21:49.389651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:49.390247 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:49.396737 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:49.397181 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:49.397952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:49.398386 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:49.555911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:49.564108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ba3d3539-334e-436d-a9bc-b913a2f6b9a4 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.178299 Jul 28 01:21:49.564693 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 482/938] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:49 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:50.589109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:50.589848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:50.599271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:50.599999 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:50.600790 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:50.601236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:50.738058 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:50.746278 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e42fbdab-5ed3-454a-ab4d-40e07bcba322 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.164511 Jul 28 01:21:50.746882 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 457/939] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:50 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:51.767849 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:51.768495 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:51.770986 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:51.771652 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:51.777972 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:51.778417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:51.779221 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:51.779656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:51.783821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:52.090651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:52.098548 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a2c252b-e31c-4109-8aa3-d1da05a98b50 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.335085 Jul 28 01:21:52.099171 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 483/940] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:51 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:53.123499 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:53.124238 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:53.127018 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:53.133506 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:53.133951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:53.134759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:53.135700 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:53.274289 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:53.282098 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e34b3f55-8def-496e-8c18-c45824a60828 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.164546 Jul 28 01:21:53.282660 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 458/941] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:53 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:54.305340 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:54.305973 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:54.315461 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:54.316043 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:54.317026 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:54.317582 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:54.466868 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:54.474881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-84925fb1-4230-4d70-9007-6884ac960d3c tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.175074 Jul 28 01:21:54.475791 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 484/942] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:54 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:55.497824 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:55.507492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:55.515065 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:55.515591 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:55.516382 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:55.516813 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:55.659464 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:55.669709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-434f17af-5914-4253-9935-0b93617f6482 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.175398 Jul 28 01:21:55.670486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 459/943] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:55 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:56.692481 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:56.693164 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:56.700305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:56.700763 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:56.701536 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:56.701978 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:56.841330 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:56.851465 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bdcf4b16-5d64-4638-8720-c819cd2726fb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.162847 Jul 28 01:21:56.852131 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 485/944] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:56 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:57.504573 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-8bfdfe3d-5d2a-4fca-9248-449a2a269fe0 req-241f6b3a-091f-4426-992b-63b7e0585739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cb86c7-bffa-49d1-abf4-1973ff6e3d47", "name": "network-vif-plugged", "status": "completed", "tag": "5d38e46e-4f07-4410-82fe-f06a06925de2"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:21:57.515930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8bfdfe3d-5d2a-4fca-9248-449a2a269fe0 req-241f6b3a-091f-4426-992b-63b7e0585739 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:57.516418 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-8bfdfe3d-5d2a-4fca-9248-449a2a269fe0 req-241f6b3a-091f-4426-992b-63b7e0585739 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:57.527990 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-8bfdfe3d-5d2a-4fca-9248-449a2a269fe0 req-241f6b3a-091f-4426-992b-63b7e0585739 service nova] Creating event network-vif-plugged:5d38e46e-4f07-4410-82fe-f06a06925de2 for instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 on hv-cinder-81558 Jul 28 01:21:57.533295 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-8bfdfe3d-5d2a-4fca-9248-449a2a269fe0 req-241f6b3a-091f-4426-992b-63b7e0585739 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Jul 28 01:21:57.533910 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 460/945] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:21:57.874688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:57.875681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:57.886185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:57.886859 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:57.888190 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:57.888854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:58.038543 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:58.046769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ff34694-bb82-4012-b9c7-1ca51c01e8db tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.177941 Jul 28 01:21:58.047363 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 486/946] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:57 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:21:59.069727 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:21:59.070424 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:21:59.072423 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:21:59.079440 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:59.079905 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:59.080671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:21:59.081131 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:21:59.231744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:21:59.239801 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2934f9dd-1062-470c-979d-690bcacf3ef1 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.174966 Jul 28 01:21:59.240349 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 461/947] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:21:59 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:00.265193 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:00.266122 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:00.274977 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:00.275425 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:00.276205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:00.276623 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:00.421443 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:00.429061 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7862808a-e43f-4e02-ac06-c7501c0f1fd3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.170537 Jul 28 01:22:00.429632 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 487/948] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:00 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:01.453380 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:01.454186 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:01.462642 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:01.463121 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:01.463920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:01.464361 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:01.610510 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:01.618777 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0824c600-208b-4958-a943-172d1bb69008 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1266 microversion: 2.1 time: 0.170053 Jul 28 01:22:01.619140 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 462/949] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:01 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:02.639964 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:02.641036 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:02.643026 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:02.648689 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:02.649133 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:02.649894 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:02.650321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:02.785889 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:02.793697 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-23e81770-b3ca-4958-a25f-7c832c076b47 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1454 microversion: 2.1 time: 0.157676 Jul 28 01:22:02.794267 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 488/950] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:02 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:02.813792 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:02.814370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:02.821314 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:02.821848 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:02.822638 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:02.823131 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:02.964806 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:02.974645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-50366286-6a54-4231-9bdd-f6e2ab4177dc tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1454 microversion: 2.1 time: 0.164685 Jul 28 01:22:02.975268 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 463/951] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:02 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:04.845356 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-ca11a188-ab16-4e1d-9722-397e101d6436 req-9e0e42ad-4076-4a85-b1b0-5cbe38e4721e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cb86c7-bffa-49d1-abf4-1973ff6e3d47", "tag": "5d38e46e-4f07-4410-82fe-f06a06925de2"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:04.856554 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ca11a188-ab16-4e1d-9722-397e101d6436 req-9e0e42ad-4076-4a85-b1b0-5cbe38e4721e service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:04.856982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ca11a188-ab16-4e1d-9722-397e101d6436 req-9e0e42ad-4076-4a85-b1b0-5cbe38e4721e service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:04.870374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-ca11a188-ab16-4e1d-9722-397e101d6436 req-9e0e42ad-4076-4a85-b1b0-5cbe38e4721e service nova] Creating event network-changed:5d38e46e-4f07-4410-82fe-f06a06925de2 for instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 on hv-cinder-81558 Jul 28 01:22:04.875492 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-ca11a188-ab16-4e1d-9722-397e101d6436 req-9e0e42ad-4076-4a85-b1b0-5cbe38e4721e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033845 Jul 28 01:22:04.876089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 489/952] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:22:25.320083 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-27bc5e2a-adcb-488e-814a-33b1d3cb8149 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:25.320734 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-27bc5e2a-adcb-488e-814a-33b1d3cb8149 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:25.322823 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=5 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:25.323528 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=44 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:25.329266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27bc5e2a-adcb-488e-814a-33b1d3cb8149 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:25.329713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27bc5e2a-adcb-488e-814a-33b1d3cb8149 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:25.330476 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27bc5e2a-adcb-488e-814a-33b1d3cb8149 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:25.330930 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-27bc5e2a-adcb-488e-814a-33b1d3cb8149 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:25.354575 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-27bc5e2a-adcb-488e-814a-33b1d3cb8149 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/ips" status: 200 len: 149 microversion: 2.1 time: 0.038506 Jul 28 01:22:25.355181 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 464/953] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:22:25 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:22:26.748900 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:26.749656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=36 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:26.754567 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a2facc2f-8b95-4f10-b83e-16318a1330c2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2059ac72-19e8-47ce-b1cc-1981cf742269"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:26.757358 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a2facc2f-8b95-4f10-b83e-16318a1330c2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:26.764457 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2facc2f-8b95-4f10-b83e-16318a1330c2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:26.765185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2facc2f-8b95-4f10-b83e-16318a1330c2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:26.765985 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2facc2f-8b95-4f10-b83e-16318a1330c2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:26.766551 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2facc2f-8b95-4f10-b83e-16318a1330c2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:27.029556 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a2facc2f-8b95-4f10-b83e-16318a1330c2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282017 Jul 28 01:22:27.030169 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 490/954] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:22:26 2022] POST /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:22:33.529811 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-751c39c1-1534-4b76-be43-f0b863f67627 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: .version_select at 0x7ff71c6af940>, body: {"keypair": {"name": "tempest-keypair-526961299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVRngGuvE5G2tAwgVduZetzutwA1OCPxfjQ36zBBa0ZwGDD2RftCBWA3ZXR2MDO4MTyXJ8hUhPGy8KJKJ2d0SXOM3mWq8xEGdqhZsX+xx3mIVUnIUuqCN7dFt35qth0gw=="}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:33.551635 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-751c39c1-1534-4b76-be43-f0b863f67627 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:22:33.555591 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-751c39c1-1534-4b76-be43-f0b863f67627 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:22:33.580609 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-751c39c1-1534-4b76-be43-f0b863f67627 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056691 Jul 28 01:22:33.581167 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 465/955] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:22:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:22:35.187569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-151385763", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bac661c0-9620-4ebf-b1dc-5201ea1d9315"}], "security_groups": [{"name": "tempest-securitygroup--1821555885"}], "key_name": "tempest-keypair-526961299", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:35.300354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] validate_networks() for [('bac661c0-9620-4ebf-b1dc-5201ea1d9315', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:22:35.695887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:22:35.696309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:22:35.696778 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:22:35.697191 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:22:35.697619 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:22:35.706967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:35.707414 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:35.708245 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:35.708677 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:35.726095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:22:35.731938 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:22:35.743395 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:22:35.745762 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:22:35.795257 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73c13938-d997-4e92-a7e5-8ebd5b77deac tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612894 Jul 28 01:22:35.795909 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 491/956] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:22:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:22:35.804402 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=4 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:35.809122 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9ac0f883-5e50-4e46-93df-628ee59b171c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:35.809823 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9ac0f883-5e50-4e46-93df-628ee59b171c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:35.865716 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-9ac0f883-5e50-4e46-93df-628ee59b171c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:35.872599 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9ac0f883-5e50-4e46-93df-628ee59b171c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1240 microversion: 2.1 time: 0.069493 Jul 28 01:22:35.873166 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 466/957] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:35 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:22:36.894806 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:36.895342 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:36.901915 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:36.902360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:36.903144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:36.903611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:36.972316 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:36.984312 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-05b69f36-4d25-486a-94c8-c725bfe3cc39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1298 microversion: 2.1 time: 0.094137 Jul 28 01:22:36.985252 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 492/958] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:36 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:38.006676 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:38.008003 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:38.016845 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.017671 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.018650 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.019434 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.268904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-5e1b509f-7099-49d0-a84b-c4f97c80cdcb req-98d66361-b364-424c-8ab7-084d330cb788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1d5ccc-bac3-414d-9fdc-75722fb41926", "tag": "2633d285-d7b7-4c4c-90f6-16f532d8b0d5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:38.300231 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5e1b509f-7099-49d0-a84b-c4f97c80cdcb req-98d66361-b364-424c-8ab7-084d330cb788 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.300706 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5e1b509f-7099-49d0-a84b-c4f97c80cdcb req-98d66361-b364-424c-8ab7-084d330cb788 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.322868 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-5e1b509f-7099-49d0-a84b-c4f97c80cdcb req-98d66361-b364-424c-8ab7-084d330cb788 service nova] Creating event network-changed:2633d285-d7b7-4c4c-90f6-16f532d8b0d5 for instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 on hv-cinder-81558 Jul 28 01:22:38.332132 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-5e1b509f-7099-49d0-a84b-c4f97c80cdcb req-98d66361-b364-424c-8ab7-084d330cb788 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068805 Jul 28 01:22:38.332410 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:38.333568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 493/959] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:22:38.340923 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-eb6efe0f-e7dd-4ef7-9f81-edaa4c49096f tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.338613 Jul 28 01:22:38.364394 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 467/960] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:38 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:38.405090 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:38.405681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:38.414943 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.420023 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-87303f49-a393-4c37-a277-8341a20e233b req-ffee188f-f1b9-438b-a9fa-7d55f8f0f15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183b3616-c163-4cad-a062-6d0637e9d642", "tag": "79e0f07f-163d-476a-bcb0-0be5f3ea5eff"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:38.424029 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.425022 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.427108 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.435420 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-87303f49-a393-4c37-a277-8341a20e233b req-ffee188f-f1b9-438b-a9fa-7d55f8f0f15f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.437195 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-87303f49-a393-4c37-a277-8341a20e233b req-ffee188f-f1b9-438b-a9fa-7d55f8f0f15f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.460518 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-87303f49-a393-4c37-a277-8341a20e233b req-ffee188f-f1b9-438b-a9fa-7d55f8f0f15f service nova] Creating event network-changed:79e0f07f-163d-476a-bcb0-0be5f3ea5eff for instance 183b3616-c163-4cad-a062-6d0637e9d642 on hv-cinder-81558 Jul 28 01:22:38.475812 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:22:38.479453 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-87303f49-a393-4c37-a277-8341a20e233b req-ffee188f-f1b9-438b-a9fa-7d55f8f0f15f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062902 Jul 28 01:22:38.482406 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 468/961] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:22:38.604309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-58d5982f-20fb-49db-915d-f8a0610ee39e tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "DELETE /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 204 len: 0 microversion: 2.1 time: 0.203259 Jul 28 01:22:38.605332 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 494/962] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:22:38 2022] DELETE /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:22:38.614389 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:38.615305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:38.622237 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.622684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.623517 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:38.623967 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:38.771699 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:38.793751 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-7cf781c2-5ef5-4628-8be5-468e1dec7483 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.183791 Jul 28 01:22:38.795814 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 469/963] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:38 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:22:39.362408 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:39.363132 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:39.370781 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:39.371262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:39.372040 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:39.372470 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:39.516631 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:39.524729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-15bc877a-860b-4423-8e53-f2bb1084e3ab tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.166578 Jul 28 01:22:39.525435 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 495/964] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:39 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:39.817982 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:39.818626 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:39.825854 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:39.826417 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:39.827246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:39.827679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:40.033520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:40.042286 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a8359bcb-4096-4b6b-8099-05dab1157319 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.228192 Jul 28 01:22:40.049044 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 470/965] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:39 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:40.546775 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:40.547464 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:40.554681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:40.555168 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:40.555982 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:40.556417 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:40.701694 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:40.709892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ba401138-e661-4f64-b4a1-ae0e19db5aeb tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.167699 Jul 28 01:22:40.710478 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 496/966] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:40 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:41.066508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:41.067311 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:41.076174 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:41.077004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:41.077988 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:41.078426 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:41.259480 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:41.267687 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e7d5c8ec-0a59-4179-b7eb-cc67885bf4d1 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1568 microversion: 2.1 time: 0.206668 Jul 28 01:22:41.268242 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 471/967] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:41 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:41.730893 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:41.731528 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:41.738617 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:41.739098 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:41.739892 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:41.740334 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:41.879003 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:41.887368 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-99f24f1e-2105-4e01-96e0-d88f24b487ba tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.160347 Jul 28 01:22:41.887932 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 497/968] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:41 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:42.289037 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:42.290233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:42.298255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:42.298255 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:42.299153 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:42.299589 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:42.340988 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-65742e09-c838-4b8b-bee0-bb96b4be9184 req-1ee4af30-1716-4664-9f6b-18ac3485827c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183b3616-c163-4cad-a062-6d0637e9d642", "name": "network-vif-deleted", "tag": "79e0f07f-163d-476a-bcb0-0be5f3ea5eff"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:42.350918 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-65742e09-c838-4b8b-bee0-bb96b4be9184 req-1ee4af30-1716-4664-9f6b-18ac3485827c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:42.351370 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-65742e09-c838-4b8b-bee0-bb96b4be9184 req-1ee4af30-1716-4664-9f6b-18ac3485827c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:42.362546 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-65742e09-c838-4b8b-bee0-bb96b4be9184 req-1ee4af30-1716-4664-9f6b-18ac3485827c service nova] Creating event network-vif-deleted:79e0f07f-163d-476a-bcb0-0be5f3ea5eff for instance 183b3616-c163-4cad-a062-6d0637e9d642 on hv-cinder-81558 Jul 28 01:22:42.369827 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee7bd9e4fa14b159277977043f4813c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1331035c6654c0d9c8ba49f5a724f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:42.372282 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-65742e09-c838-4b8b-bee0-bb96b4be9184 req-1ee4af30-1716-4664-9f6b-18ac3485827c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034765 Jul 28 01:22:42.373550 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 498/969] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:22:42.378800 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8037afa6-38f5-4fd9-a282-c6f91937575c tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 200 len: 1383 microversion: 2.1 time: 0.093609 Jul 28 01:22:42.379421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 472/970] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:42 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 1383 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:42.911834 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:42.912898 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:42.921717 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:42.922194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:42.923206 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:42.923904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:43.066969 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:43.075377 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2148349f-5c3d-4c93-9eb1-b10ce485b464 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.170729 Jul 28 01:22:43.076428 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 499/971] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:42 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:43.403062 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:43.403713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] [instance: 183b3616-c163-4cad-a062-6d0637e9d642] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:43.411457 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:43.411912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:43.412711 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:43.413149 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:43.428639 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] HTTP exception thrown: Instance 183b3616-c163-4cad-a062-6d0637e9d642 could not be found. Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Request method failure captured: Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 HTTP/1.1 Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eO0iyXLFf5reaSiz_b9-qbLCXXO6avIyztvXx2fzxfqvnqE1MGkLox_xGoiP2kXnIANtuw455SSIORbZS-voZAex-Ew9-M0D-NFyqdzhlYFVAZUKf7ptJYrYwV40dw7hxYAVZA4Il8NA6RyyZXWAb75SyiWKA041wxGrE06lwxHrFU Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: b1331035c6654c0d9c8ba49f5a724f8c Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-TestShelveInstance-178199375 Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:22:43.430368 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b1331035c6654c0d9c8ba49f5a724f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b1331035c6654c0d9c8ba49f5a724f8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b1331035c6654c0d9c8ba49f5a724f8c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b1331035c6654c0d9c8ba49f5a724f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-TestShelveInstance-178199375 Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: b1331035c6654c0d9c8ba49f5a724f8c Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-TestShelveInstance-178199375 Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-TestShelveInstance-178199375-project Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: eee7bd9e4fa14b159277977043f4813c Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-TestShelveInstance-178199375-project Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 183b3616-c163-4cad-a062-6d0637e9d642 could not be found. Jul 28 01:22:43.432137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '183b3616-c163-4cad-a062-6d0637e9d642'} Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183b3616-c163-4cad-a062-6d0637e9d642 could not be found. Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:22:43.433350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183b3616-c163-4cad-a062-6d0637e9d642 could not be found. Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183b3616-c163-4cad-a062-6d0637e9d642 could not be found. Jul 28 01:22:43.435252 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:22:43.437134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Returning 404 to user: Instance 183b3616-c163-4cad-a062-6d0637e9d642 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:22:43.437134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8212d241-c6b6-4315-bc2e-90f597f3add9 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642" status: 404 len: 111 microversion: 2.1 time: 0.032866 Jul 28 01:22:43.437134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 473/972] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:43 2022] GET /compute/v2.1/servers/183b3616-c163-4cad-a062-6d0637e9d642 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:22:43.602200 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-996c70f7-35e4-4d1e-9140-280ac0923015 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] Calling method '.version_select at 0x7ff71c3a7a60>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:43.624041 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-996c70f7-35e4-4d1e-9140-280ac0923015 tempest-TestShelveInstance-178199375 tempest-TestShelveInstance-178199375-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1209159014" status: 202 len: 0 microversion: 2.1 time: 0.026274 Jul 28 01:22:43.624621 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 500/973] 10.222.0.17 () {58 vars in 1254 bytes} [Thu Jul 28 01:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1209159014 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:22:44.097306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:44.097929 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:44.104352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:44.104802 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:44.105592 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:44.106017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:44.248614 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:44.257184 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-bc7d5ad2-9930-433d-a333-ebc865156123 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.164130 Jul 28 01:22:44.257912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 474/974] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:44 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:22:45.278644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:45.279367 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:45.285623 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:45.286073 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:45.286861 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:45.287438 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:45.435837 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:45.444725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-246db931-896e-4274-8494-0672c957a9f3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.170722 Jul 28 01:22:45.445321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 501/975] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:45 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:46.048315 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-317b09cd-9fb4-4981-a936-6ac8d680a706 req-34fc2342-f612-4883-8bae-6ebaf458c8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1d5ccc-bac3-414d-9fdc-75722fb41926", "name": "network-vif-plugged", "status": "completed", "tag": "2633d285-d7b7-4c4c-90f6-16f532d8b0d5"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:46.054582 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:46.061837 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-317b09cd-9fb4-4981-a936-6ac8d680a706 req-34fc2342-f612-4883-8bae-6ebaf458c8b1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:46.062361 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-317b09cd-9fb4-4981-a936-6ac8d680a706 req-34fc2342-f612-4883-8bae-6ebaf458c8b1 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:46.074114 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-317b09cd-9fb4-4981-a936-6ac8d680a706 req-34fc2342-f612-4883-8bae-6ebaf458c8b1 service nova] Creating event network-vif-plugged:2633d285-d7b7-4c4c-90f6-16f532d8b0d5 for instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 on hv-cinder-81558 Jul 28 01:22:46.079504 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-317b09cd-9fb4-4981-a936-6ac8d680a706 req-34fc2342-f612-4883-8bae-6ebaf458c8b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035640 Jul 28 01:22:46.080282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 475/976] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:22:46.466596 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:46.467234 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:46.469698 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:46.471569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:22:46.477285 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:46.477751 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:46.479085 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:46.479085 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:46.664799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:46.674959 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6f80d75b-9daf-4b74-9398-8886c5479e39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.212101 Jul 28 01:22:46.675553 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 502/977] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:46 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:47.697438 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:47.698236 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:47.705527 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:47.705920 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:47.706651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:47.707177 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:47.948968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:47.957009 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c5dcae19-289e-41a7-a411-6e5586118482 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1366 microversion: 2.1 time: 0.264411 Jul 28 01:22:47.957664 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 476/978] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:47 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:48.979216 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:48.980063 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:48.987640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:48.988175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:48.989024 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:48.989514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:49.217165 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:22:49.225180 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-42a4c984-631e-4144-9058-4856f62c674a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1556 microversion: 2.1 time: 0.250675 Jul 28 01:22:49.225911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 503/979] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:22:48 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1556 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:22:49.246789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-23ac8322-b1eb-4623-9680-05befa74c89c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:22:49.247388 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-23ac8322-b1eb-4623-9680-05befa74c89c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:22:49.253703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23ac8322-b1eb-4623-9680-05befa74c89c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:49.254419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23ac8322-b1eb-4623-9680-05befa74c89c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:49.255585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23ac8322-b1eb-4623-9680-05befa74c89c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:49.256016 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23ac8322-b1eb-4623-9680-05befa74c89c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:49.380689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-23ac8322-b1eb-4623-9680-05befa74c89c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137781 Jul 28 01:22:49.381619 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 477/980] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:22:49 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:22:50.424819 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-5db55354-a478-4180-aed9-d1e41b10aad4 req-8fd89e3f-5970-4c17-bd4d-d13360359348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1d5ccc-bac3-414d-9fdc-75722fb41926", "tag": "2633d285-d7b7-4c4c-90f6-16f532d8b0d5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:22:50.434941 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5db55354-a478-4180-aed9-d1e41b10aad4 req-8fd89e3f-5970-4c17-bd4d-d13360359348 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:22:50.435298 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-5db55354-a478-4180-aed9-d1e41b10aad4 req-8fd89e3f-5970-4c17-bd4d-d13360359348 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:22:50.452589 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-5db55354-a478-4180-aed9-d1e41b10aad4 req-8fd89e3f-5970-4c17-bd4d-d13360359348 service nova] Creating event network-changed:2633d285-d7b7-4c4c-90f6-16f532d8b0d5 for instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 on hv-cinder-81558 Jul 28 01:22:50.458443 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-5db55354-a478-4180-aed9-d1e41b10aad4 req-8fd89e3f-5970-4c17-bd4d-d13360359348 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037371 Jul 28 01:22:50.459072 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 504/981] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:25.054384 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:25.055178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=52 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:25.059452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-23c459c6-2002-48fa-ae3b-d8449c8f8ae8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:25.059951 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-23c459c6-2002-48fa-ae3b-d8449c8f8ae8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:25.067595 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23c459c6-2002-48fa-ae3b-d8449c8f8ae8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.068049 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23c459c6-2002-48fa-ae3b-d8449c8f8ae8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.068833 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23c459c6-2002-48fa-ae3b-d8449c8f8ae8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.069264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-23c459c6-2002-48fa-ae3b-d8449c8f8ae8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.093699 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-23c459c6-2002-48fa-ae3b-d8449c8f8ae8 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926/ips" status: 200 len: 149 microversion: 2.1 time: 0.041202 Jul 28 01:23:25.094312 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 478/982] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:23:25 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:25.104593 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:25.105348 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:25.109708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2059ac72-19e8-47ce-b1cc-1981cf742269"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:25.112192 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:25.120274 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.120723 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.121492 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.121951 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.208784 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Invalid volume: volume 2059ac72-19e8-47ce-b1cc-1981cf742269 is already attached to instances: d5671e0a-fdd0-4692-93aa-4ff5ef293562 Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: POST /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926/os-volume_attachments HTTP/1.1 Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 74 Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:23:25.211516 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {"volumeAttachment": {"volumeId": "2059ac72-19e8-47ce-b1cc-1981cf742269"}} Jul 28 01:23:25.213660 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Invalid volume: volume 2059ac72-19e8-47ce-b1cc-1981cf742269 is already attached to instances: d5671e0a-fdd0-4692-93aa-4ff5ef293562 Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'server_id': '0f1d5ccc-bac3-414d-9fdc-75722fb41926', 'body': {'volumeAttachment': {'volumeId': '2059ac72-19e8-47ce-b1cc-1981cf742269'}}} Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2059ac72-19e8-47ce-b1cc-1981cf742269 is already attached to instances: d5671e0a-fdd0-4692-93aa-4ff5ef293562 Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:25.215574 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2059ac72-19e8-47ce-b1cc-1981cf742269 is already attached to instances: d5671e0a-fdd0-4692-93aa-4ff5ef293562 Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:25.217054 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2059ac72-19e8-47ce-b1cc-1981cf742269 is already attached to instances: d5671e0a-fdd0-4692-93aa-4ff5ef293562 Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 400 to user: Invalid volume: volume 2059ac72-19e8-47ce-b1cc-1981cf742269 is already attached to instances: d5671e0a-fdd0-4692-93aa-4ff5ef293562 {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9e8adbe9-cfd1-4f90-a590-a2d80f3481ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110521 Jul 28 01:23:25.218606 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 505/983] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:23:25 2022] POST /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:23:25.224134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:25.224640 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:25.233015 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.233611 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.234603 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.235221 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.263479 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:23:25.341551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-6c37076e-208c-4d04-87fa-1affb7b1c466 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 204 len: 0 microversion: 2.1 time: 0.120967 Jul 28 01:23:25.342203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 479/984] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:23:25 2022] DELETE /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:23:25.351070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:25.351690 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:25.359140 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.359585 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.360356 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:25.360802 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:25.501935 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:25.510198 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2a26445d-155a-48a4-94f3-33fa246c7500 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1680 microversion: 2.1 time: 0.163324 Jul 28 01:23:25.510799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 506/985] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:25 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:26.535448 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:26.536460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:26.544862 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:26.545311 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:26.546084 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:26.546523 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:26.688532 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:26.696253 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fb4551fb-6f3a-4d44-b859-151300fb1a3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1680 microversion: 2.1 time: 0.166965 Jul 28 01:23:26.696824 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 480/986] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:26 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:27.600056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-ba51cf72-830e-4208-8aaf-58c8b0c43b62 req-c12bd062-f1ac-4b0d-a6fc-d247d3dd57a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1d5ccc-bac3-414d-9fdc-75722fb41926", "name": "network-vif-deleted", "tag": "2633d285-d7b7-4c4c-90f6-16f532d8b0d5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:27.615077 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ba51cf72-830e-4208-8aaf-58c8b0c43b62 req-c12bd062-f1ac-4b0d-a6fc-d247d3dd57a5 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:27.615854 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ba51cf72-830e-4208-8aaf-58c8b0c43b62 req-c12bd062-f1ac-4b0d-a6fc-d247d3dd57a5 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:27.630611 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-ba51cf72-830e-4208-8aaf-58c8b0c43b62 req-c12bd062-f1ac-4b0d-a6fc-d247d3dd57a5 service nova] Creating event network-vif-deleted:2633d285-d7b7-4c4c-90f6-16f532d8b0d5 for instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 on hv-cinder-81558 Jul 28 01:23:27.637134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-ba51cf72-830e-4208-8aaf-58c8b0c43b62 req-c12bd062-f1ac-4b0d-a6fc-d247d3dd57a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040175 Jul 28 01:23:27.638016 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 507/987] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:27.717086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:27.717709 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:27.729585 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:27.730307 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:27.731327 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:27.731927 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:27.771904 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:27.772511 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:27.773086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lazy-loading 'fault' on Instance uuid 0f1d5ccc-bac3-414d-9fdc-75722fb41926 {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:23:27.818581 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:27.827108 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8fe1daa2-5111-4bca-825a-af2f64e34769 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 200 len: 1330 microversion: 2.1 time: 0.114015 Jul 28 01:23:27.827971 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 481/988] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:27 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:28.853837 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:28.854656 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:28.861925 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:28.862377 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:28.863183 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:28.863619 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:28.877799 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 HTTP/1.1 Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:23:28.879469 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:23:28.881442 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '0f1d5ccc-bac3-414d-9fdc-75722fb41926'} Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:23:28.882328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:23:28.883867 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:28.885325 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:23:28.885325 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f95a5a4d-8efb-45ae-8160-9843d37a5ba0 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 404 len: 111 microversion: 2.1 time: 0.034805 Jul 28 01:23:28.885325 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 508/989] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:28 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:23:28.890280 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f1f8871c-e671-4e1c-99f2-feda5938f0cc tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '.version_select at 0x7ff71c6c1f70>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:28.911693 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f1f8871c-e671-4e1c-99f2-feda5938f0cc tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526961299" status: 202 len: 0 microversion: 2.1 time: 0.025271 Jul 28 01:23:28.912268 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 482/990] 10.222.0.17 () {58 vars in 1218 bytes} [Thu Jul 28 01:23:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526961299 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:23:29.625415 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:29.625899 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:29.633080 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:29.633523 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:29.634320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:29.634748 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:29.720185 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lazy-loading 'services' on Instance uuid d5671e0a-fdd0-4692-93aa-4ff5ef293562 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:23:29.797338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2dea355-49c1-4d23-995c-ee0710d6a297 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments/2059ac72-19e8-47ce-b1cc-1981cf742269" status: 202 len: 0 microversion: 2.1 time: 0.175732 Jul 28 01:23:29.797936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 509/991] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:23:29 2022] DELETE /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments/2059ac72-19e8-47ce-b1cc-1981cf742269 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:23:29.806705 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-006c8ac2-d379-4119-8dfc-add784811991 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:29.809135 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-006c8ac2-d379-4119-8dfc-add784811991 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:29.816164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-006c8ac2-d379-4119-8dfc-add784811991 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:29.816648 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-006c8ac2-d379-4119-8dfc-add784811991 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:29.817475 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-006c8ac2-d379-4119-8dfc-add784811991 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:29.817964 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-006c8ac2-d379-4119-8dfc-add784811991 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:29.847967 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-006c8ac2-d379-4119-8dfc-add784811991 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045308 Jul 28 01:23:29.848520 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 483/992] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:23:29 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:30.863676 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6c452bcb-4d00-461f-be17-0af6a2c5e062 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:30.866176 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6c452bcb-4d00-461f-be17-0af6a2c5e062 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:30.874095 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c452bcb-4d00-461f-be17-0af6a2c5e062 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:30.874636 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c452bcb-4d00-461f-be17-0af6a2c5e062 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:30.875583 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c452bcb-4d00-461f-be17-0af6a2c5e062 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:30.876144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c452bcb-4d00-461f-be17-0af6a2c5e062 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:30.908153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6c452bcb-4d00-461f-be17-0af6a2c5e062 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050140 Jul 28 01:23:30.909020 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 510/993] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:23:30 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:23:30.977593 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:30.978160 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:30.986301 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:30.986752 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:30.987554 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:30.987991 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:31.014718 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:23:31.102494 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-9720f0ec-7806-4294-845a-d5521e49071c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 204 len: 0 microversion: 2.1 time: 0.130094 Jul 28 01:23:31.103720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 484/994] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:23:30 2022] DELETE /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:23:31.116182 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:31.116952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:31.125212 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:31.125730 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:31.126467 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:31.126934 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:31.526353 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:31.535034 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a392191-4bde-46b0-b9a9-2a9668e64005 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1682 microversion: 2.1 time: 0.425114 Jul 28 01:23:31.535613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 511/995] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:31 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1682 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:32.557616 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:32.558192 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:32.565194 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:32.566199 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:32.567024 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:32.567421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:32.853654 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:32.862233 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-4700789a-14b3-4dae-9af1-64bf3d5e7753 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1682 microversion: 2.1 time: 0.308905 Jul 28 01:23:32.863220 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 485/996] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:32 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:33.001868 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:33.003048 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:33.007380 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-f7de8360-0bfe-479d-bb6f-7365c69c4eb8 req-a6e96faa-b6a8-42c3-b112-60222bf2f69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7cb86c7-bffa-49d1-abf4-1973ff6e3d47", "tag": "5d38e46e-4f07-4410-82fe-f06a06925de2"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:33.014475 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.015034 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.018212 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-f7de8360-0bfe-479d-bb6f-7365c69c4eb8 req-a6e96faa-b6a8-42c3-b112-60222bf2f69f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.018649 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-f7de8360-0bfe-479d-bb6f-7365c69c4eb8 req-a6e96faa-b6a8-42c3-b112-60222bf2f69f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.019217 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.019729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.031782 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-f7de8360-0bfe-479d-bb6f-7365c69c4eb8 req-a6e96faa-b6a8-42c3-b112-60222bf2f69f service nova] Creating event network-changed:5d38e46e-4f07-4410-82fe-f06a06925de2 for instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 on hv-cinder-81558 Jul 28 01:23:33.036817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-f7de8360-0bfe-479d-bb6f-7365c69c4eb8 req-a6e96faa-b6a8-42c3-b112-60222bf2f69f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035796 Jul 28 01:23:33.040402 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 486/997] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:23:33.054134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:23:33.148008 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9c50d951-f899-4b98-8e97-ee47986ae402 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 204 len: 0 microversion: 2.1 time: 0.149833 Jul 28 01:23:33.148893 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 512/998] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:23:32 2022] DELETE /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:23:33.157702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:33.158408 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:33.164725 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.165161 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.165985 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.166415 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.313093 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:33.322729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b2af8c38-b5b7-4857-ada0-d10a0da72ce3 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1579 microversion: 2.1 time: 0.169187 Jul 28 01:23:33.323616 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 487/999] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:33 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:33.732681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-b98a812c-c658-4f05-a52b-1a6d2e016ae9 req-5d205711-e0a1-4e28-b0b4-08da66f24589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5671e0a-fdd0-4692-93aa-4ff5ef293562", "name": "network-vif-deleted", "tag": "0f4b842e-8b20-44f6-b3fc-362c3ed518c8"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:33.742447 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-b98a812c-c658-4f05-a52b-1a6d2e016ae9 req-5d205711-e0a1-4e28-b0b4-08da66f24589 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.743023 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-b98a812c-c658-4f05-a52b-1a6d2e016ae9 req-5d205711-e0a1-4e28-b0b4-08da66f24589 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.754394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-b98a812c-c658-4f05-a52b-1a6d2e016ae9 req-5d205711-e0a1-4e28-b0b4-08da66f24589 service nova] Creating event network-vif-deleted:0f4b842e-8b20-44f6-b3fc-362c3ed518c8 for instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 on hv-cinder-81558 Jul 28 01:23:33.760022 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-b98a812c-c658-4f05-a52b-1a6d2e016ae9 req-5d205711-e0a1-4e28-b0b4-08da66f24589 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031429 Jul 28 01:23:33.760807 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 513/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:33.884885 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:33.886427 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:33.893645 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.894370 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.895553 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:33.896276 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:33.962344 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:33.970139 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dd7a6b32-b605-4c0f-b3dc-6b5c17b4ec07 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 200 len: 1614 microversion: 2.1 time: 0.089135 Jul 28 01:23:33.971045 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 488/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:33 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:34.345421 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:34.346767 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:34.355395 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:34.356448 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:34.357573 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:34.358167 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:34.496351 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:34.504480 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6ebc5242-590a-46a3-8db3-e5508b6a882b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1579 microversion: 2.1 time: 0.163434 Jul 28 01:23:34.505462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 514/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:34 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:34.992365 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:34.992847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:35.000060 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:35.000515 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:35.001296 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:35.001732 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:35.016111 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 HTTP/1.1 Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:23:35.017963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:23:35.019637 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'd5671e0a-fdd0-4692-93aa-4ff5ef293562'} Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:23:35.020551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:23:35.022055 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:35.023488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:23:35.023488 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b7261aeb-3838-46e3-b4f7-b954cc9c54a4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 404 len: 111 microversion: 2.1 time: 0.031478 Jul 28 01:23:35.023674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 489/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:34 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:23:35.028720 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-898ea6fa-f527-4c7a-a041-b08f23328d74 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '.version_select at 0x7ff71c405af0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:35.050588 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-898ea6fa-f527-4c7a-a041-b08f23328d74 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473836575" status: 202 len: 0 microversion: 2.1 time: 0.025652 Jul 28 01:23:35.051594 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 515/1004] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Jul 28 01:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473836575 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:23:35.526789 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:35.527619 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:35.534217 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:35.535092 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:35.536178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:35.536690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:35.613490 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:35.622271 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-dbef30a8-7bbd-42b8-98ff-5c22a2ce1223 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 200 len: 1225 microversion: 2.1 time: 0.099362 Jul 28 01:23:35.622896 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 490/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:35 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:35.755561 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f0979a85-9d5e-4e34-b00f-2f1000d07b0c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: .version_select at 0x7ff71c3a7430>, body: {"keypair": {"name": "tempest-keypair-1229861701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHltsPD+COfx/eT57GNFUVBUcgWuBsn0I+ZYTXgPoBZTCz//2iyyG+JIBwjzyx0IdIAupwfsz5etmLOpyq6k4fMQIxBAaQflHG1ALoQxyfYsgL4xZVVVuzjgnxdk/wuKQ=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:35.774244 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-f0979a85-9d5e-4e34-b00f-2f1000d07b0c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:23:35.775710 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-2bd32926-a26b-4622-a23d-9d44d62df91c req-d01ac0a4-5135-4aa4-a918-01785215dc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7cb86c7-bffa-49d1-abf4-1973ff6e3d47", "name": "network-vif-deleted", "tag": "5d38e46e-4f07-4410-82fe-f06a06925de2"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:35.778344 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-f0979a85-9d5e-4e34-b00f-2f1000d07b0c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:23:35.787963 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-2bd32926-a26b-4622-a23d-9d44d62df91c req-d01ac0a4-5135-4aa4-a918-01785215dc0f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:35.788398 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-2bd32926-a26b-4622-a23d-9d44d62df91c req-d01ac0a4-5135-4aa4-a918-01785215dc0f service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:35.800667 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-2bd32926-a26b-4622-a23d-9d44d62df91c req-d01ac0a4-5135-4aa4-a918-01785215dc0f service nova] Creating event network-vif-deleted:5d38e46e-4f07-4410-82fe-f06a06925de2 for instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 on hv-cinder-81558 Jul 28 01:23:35.803370 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f0979a85-9d5e-4e34-b00f-2f1000d07b0c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052938 Jul 28 01:23:35.804868 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 516/1006] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:23:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:35.805720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-2bd32926-a26b-4622-a23d-9d44d62df91c req-d01ac0a4-5135-4aa4-a918-01785215dc0f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033666 Jul 28 01:23:35.806310 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 491/1007] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:36.194050 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:23:36.194641 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Thu Jul 28 01:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:23:36.644375 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:36.645006 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: a7cb86c7-bffa-49d1-abf4-1973ff6e3d47] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:36.651541 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:36.651979 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:36.653070 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:36.653498 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:36.666952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] HTTP exception thrown: Instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 could not be found. Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Request method failure captured: Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 HTTP/1.1 Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eMtzwkLQ1rn8Dl0B5zAdjHygkUVQIiH_HqnSND2HI2d_H3NWBEQbksnaf8BpyAi5f0I3dl2XB7fON2r93CnLE4sr-2ry9R5B_aR040dut_inZWj2hJjojyTLVxoRn7XhLFeWwR8Swh9hMlN5GCdpV1Fish2N5v0cyUITcLBDXJ9eeU Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:23:36.668602 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d14de33f76ea44db8899900481299b87", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d14de33f76ea44db8899900481299b87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: d9cb42db2f9a4b80b17bef0a86945a6c Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 could not be found. Jul 28 01:23:36.670224 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'a7cb86c7-bffa-49d1-abf4-1973ff6e3d47'} Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 could not be found. Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:23:36.671153 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 could not be found. Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 could not be found. Jul 28 01:23:36.672635 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:36.673919 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Returning 404 to user: Instance a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:23:36.673919 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2cca71b3-f938-489f-b8d5-5289e870d3eb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47" status: 404 len: 111 microversion: 2.1 time: 0.029842 Jul 28 01:23:36.673919 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 517/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:36 2022] GET /compute/v2.1/servers/a7cb86c7-bffa-49d1-abf4-1973ff6e3d47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:23:37.442321 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1483010476", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bac661c0-9620-4ebf-b1dc-5201ea1d9315"}], "security_groups": [{"name": "tempest-securitygroup--1581871664"}], "key_name": "tempest-keypair-1229861701", "user_data": "}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:37.559361 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] validate_networks() for [('bac661c0-9620-4ebf-b1dc-5201ea1d9315', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:23:37.960078 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:23:37.960529 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:23:37.961027 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:23:37.961425 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:23:37.961815 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:23:37.971045 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:37.971486 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:37.972277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:37.972705 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:37.989138 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:23:37.993134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:23:38.005551 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:23:38.007944 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:23:38.056849 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-507059bf-cc44-46bd-848b-e25fd31fb643 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621849 Jul 28 01:23:38.057745 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 492/1009] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:23:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:23:38.069630 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-199676b6-6b86-4551-bcff-4c89b4208266 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:38.070902 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-199676b6-6b86-4551-bcff-4c89b4208266 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:38.131030 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-199676b6-6b86-4551-bcff-4c89b4208266 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:38.137934 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-199676b6-6b86-4551-bcff-4c89b4208266 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1242 microversion: 2.1 time: 0.072382 Jul 28 01:23:38.138600 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 518/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:38 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:39.160082 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:39.160653 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:39.168101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:39.168493 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:39.169275 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:39.169805 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:39.242273 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:39.251661 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b9979a4b-5256-4a25-ad75-ebc80f39b78e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1302 microversion: 2.1 time: 0.096049 Jul 28 01:23:39.252805 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 493/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:39 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:40.273779 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:40.274426 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:40.282729 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:40.283208 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:40.283970 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:40.284401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:40.354288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:40.362484 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d50c1ce7-b32a-423c-b913-46a608cdfd03 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1300 microversion: 2.1 time: 0.092752 Jul 28 01:23:40.363089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 519/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:40 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:40.539499 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:40.540325 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:40.547166 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:40.547869 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:40.548651 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:40.549068 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:40.565128 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-68794e13-bd95-469b-a39f-2e44b9dc071f req-a440d342-ae59-4db6-b80b-0d845f8b76d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef8c75-a39b-4af4-813b-7d195164631d", "tag": "5e443d88-263d-417b-a4b5-1c7b5ec04947"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:40.584134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:23:40.588465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:40.644741 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-68794e13-bd95-469b-a39f-2e44b9dc071f req-a440d342-ae59-4db6-b80b-0d845f8b76d9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:40.645392 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-68794e13-bd95-469b-a39f-2e44b9dc071f req-a440d342-ae59-4db6-b80b-0d845f8b76d9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:40.671682 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-68794e13-bd95-469b-a39f-2e44b9dc071f req-a440d342-ae59-4db6-b80b-0d845f8b76d9 service nova] Creating event network-changed:5e443d88-263d-417b-a4b5-1c7b5ec04947 for instance 3aef8c75-a39b-4af4-813b-7d195164631d on hv-cinder-81558 Jul 28 01:23:40.678116 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-68794e13-bd95-469b-a39f-2e44b9dc071f req-a440d342-ae59-4db6-b80b-0d845f8b76d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119243 Jul 28 01:23:40.679205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 520/1013] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:23:40.698987 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-02850fa6-ace5-4519-96f2-d7f1f03e762a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 204 len: 0 microversion: 2.1 time: 0.162749 Jul 28 01:23:40.700391 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 494/1014] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:23:40 2022] DELETE /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:23:40.709229 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:40.710027 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:40.716739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:40.717320 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:40.718292 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:40.718804 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:40.912103 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:40.922848 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82d296df-4bb9-44a5-a240-a57d015a2832 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1578 microversion: 2.1 time: 0.217892 Jul 28 01:23:40.924148 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 521/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:40 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:41.385606 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:41.386401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:41.395912 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:41.396369 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:41.397153 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:41.397991 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:41.578225 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:41.588978 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-a939dd7b-13ae-41cd-b380-11730c8761a9 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1368 microversion: 2.1 time: 0.208892 Jul 28 01:23:41.589861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 495/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:41 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:41.945739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:41.946360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:41.953089 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:41.953534 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:41.954305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:41.954733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:42.107462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:42.115946 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-44a985d2-d14d-4787-94bc-e63e3775ee42 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1578 microversion: 2.1 time: 0.174127 Jul 28 01:23:42.116519 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 522/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:41 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:42.610119 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:42.611491 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:42.618965 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:42.619806 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:42.620910 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:42.621560 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:42.694354 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-cbbd9a58-a118-4bc5-a281-d19c4b8acb9c req-40e482f3-9591-43f9-b039-dfc998c80fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ac698d-b3fd-49fa-b040-c9521c87932a", "tag": "1c124828-ba63-4126-8155-ff63fb6ffd96"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:42.705753 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-cbbd9a58-a118-4bc5-a281-d19c4b8acb9c req-40e482f3-9591-43f9-b039-dfc998c80fee service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:42.706913 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-cbbd9a58-a118-4bc5-a281-d19c4b8acb9c req-40e482f3-9591-43f9-b039-dfc998c80fee service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:42.719733 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-cbbd9a58-a118-4bc5-a281-d19c4b8acb9c req-40e482f3-9591-43f9-b039-dfc998c80fee service nova] Creating event network-changed:1c124828-ba63-4126-8155-ff63fb6ffd96 for instance f8ac698d-b3fd-49fa-b040-c9521c87932a on hv-cinder-81558 Jul 28 01:23:42.726691 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-cbbd9a58-a118-4bc5-a281-d19c4b8acb9c req-40e482f3-9591-43f9-b039-dfc998c80fee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035429 Jul 28 01:23:42.727708 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 523/1018] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:42.816997 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:42.824922 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8bdb9d34-15b9-44b8-9320-0f7a6f7b1d45 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1368 microversion: 2.1 time: 0.218734 Jul 28 01:23:42.826261 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 496/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:42 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:42.923994 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-279b6163-6f21-449c-9acd-1282f19125b8 req-5332aeb4-4d3e-46b9-9dbe-bbdb98fdc12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef8c75-a39b-4af4-813b-7d195164631d", "name": "network-vif-deleted", "tag": "5e443d88-263d-417b-a4b5-1c7b5ec04947"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:42.933640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-279b6163-6f21-449c-9acd-1282f19125b8 req-5332aeb4-4d3e-46b9-9dbe-bbdb98fdc12c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:42.934083 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-279b6163-6f21-449c-9acd-1282f19125b8 req-5332aeb4-4d3e-46b9-9dbe-bbdb98fdc12c service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:42.945547 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-279b6163-6f21-449c-9acd-1282f19125b8 req-5332aeb4-4d3e-46b9-9dbe-bbdb98fdc12c service nova] Creating event network-vif-deleted:5e443d88-263d-417b-a4b5-1c7b5ec04947 for instance 3aef8c75-a39b-4af4-813b-7d195164631d on hv-cinder-81558 Jul 28 01:23:42.950472 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-279b6163-6f21-449c-9acd-1282f19125b8 req-5332aeb4-4d3e-46b9-9dbe-bbdb98fdc12c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030692 Jul 28 01:23:42.951243 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 524/1020] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:43.138450 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:43.138968 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:43.147265 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:43.147745 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:43.148508 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:43.148938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:43.214822 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb42db2f9a4b80b17bef0a86945a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14de33f76ea44db8899900481299b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:43.223889 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-74d9673a-2c47-4287-97b9-a156501d1c1b tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 200 len: 1391 microversion: 2.1 time: 0.089697 Jul 28 01:23:43.224474 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 497/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:43 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:43.847067 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:43.847859 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:43.854466 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:43.855048 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:43.855880 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:43.856369 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:44.028188 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:44.036613 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0010e9ef-35ff-44e9-9efd-16c06d7a46e3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1368 microversion: 2.1 time: 0.194615 Jul 28 01:23:44.037225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 525/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:43 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:44.247925 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:44.248552 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 3aef8c75-a39b-4af4-813b-7d195164631d] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:44.258367 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:44.258919 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:44.260017 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:44.260602 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:44.277583 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] HTTP exception thrown: Instance 3aef8c75-a39b-4af4-813b-7d195164631d could not be found. Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Request method failure captured: Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d HTTP/1.1 Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eMtzwkLQ1rn8Dl0B5zAdjHygkUVQIiH_HqnSND2HI2d_H3NWBEQbksnaf8BpyAi5f0I3dl2XB7fON2r93CnLE4sr-2ry9R5B_aR040dut_inZWj2hJjojyTLVxoRn7XhLFeWwR8Swh9hMlN5GCdpV1Fish2N5v0cyUITcLBDXJ9eeU Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:23:44.279277 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d14de33f76ea44db8899900481299b87", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d14de33f76ea44db8899900481299b87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: d9cb42db2f9a4b80b17bef0a86945a6c Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 3aef8c75-a39b-4af4-813b-7d195164631d could not be found. Jul 28 01:23:44.280958 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '3aef8c75-a39b-4af4-813b-7d195164631d'} Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aef8c75-a39b-4af4-813b-7d195164631d could not be found. Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:23:44.281983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aef8c75-a39b-4af4-813b-7d195164631d could not be found. Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aef8c75-a39b-4af4-813b-7d195164631d could not be found. Jul 28 01:23:44.283540 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.285071 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Returning 404 to user: Instance 3aef8c75-a39b-4af4-813b-7d195164631d could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:23:44.285071 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-39565bb3-db59-4ea5-bc13-a03e0187bb3a tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d" status: 404 len: 111 microversion: 2.1 time: 0.039001 Jul 28 01:23:44.285071 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 498/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:44 2022] GET /compute/v2.1/servers/3aef8c75-a39b-4af4-813b-7d195164631d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:23:44.732262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:44.732767 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:44.739566 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:44.740018 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:44.740806 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:44.741239 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:44.755443 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] HTTP exception thrown: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Request method failure captured: Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 HTTP/1.1 Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eMtzwkLQ1rn8Dl0B5zAdjHygkUVQIiH_HqnSND2HI2d_H3NWBEQbksnaf8BpyAi5f0I3dl2XB7fON2r93CnLE4sr-2ry9R5B_aR040dut_inZWj2hJjojyTLVxoRn7XhLFeWwR8Swh9hMlN5GCdpV1Fish2N5v0cyUITcLBDXJ9eeU Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:23:44.757093 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d14de33f76ea44db8899900481299b87", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d14de33f76ea44db8899900481299b87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: d9cb42db2f9a4b80b17bef0a86945a6c Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.758739 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '49aad030-b12c-409b-b5da-ba6eb7779f32'} Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:23:44.759904 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.761400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.763079 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Returning 404 to user: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:23:44.763079 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6dcad489-5be8-4fb0-90c1-ca92c35e39bb tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 404 len: 111 microversion: 2.1 time: 0.030189 Jul 28 01:23:44.763079 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 526/1024] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:23:44 2022] DELETE /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:23:44.767297 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:44.767907 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] [instance: 49aad030-b12c-409b-b5da-ba6eb7779f32] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:44.774593 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:44.775072 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:44.775844 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:44.776304 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:44.789684 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] HTTP exception thrown: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Request method failure captured: Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 HTTP/1.1 Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eMtzwkLQ1rn8Dl0B5zAdjHygkUVQIiH_HqnSND2HI2d_H3NWBEQbksnaf8BpyAi5f0I3dl2XB7fON2r93CnLE4sr-2ry9R5B_aR040dut_inZWj2hJjojyTLVxoRn7XhLFeWwR8Swh9hMlN5GCdpV1Fish2N5v0cyUITcLBDXJ9eeU Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:23:44.791372 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d14de33f76ea44db8899900481299b87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d14de33f76ea44db8899900481299b87", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d14de33f76ea44db8899900481299b87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: d14de33f76ea44db8899900481299b87 Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-TestVolumeBootPattern-455249764 Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: d9cb42db2f9a4b80b17bef0a86945a6c Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-TestVolumeBootPattern-455249764-project Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.792979 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '49aad030-b12c-409b-b5da-ba6eb7779f32'} Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:23:44.793878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. Jul 28 01:23:44.795287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:23:44.796594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Returning 404 to user: Instance 49aad030-b12c-409b-b5da-ba6eb7779f32 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:23:44.796594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-e3e5c159-fb15-4121-9934-c40673ae2429 tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32" status: 404 len: 111 microversion: 2.1 time: 0.029469 Jul 28 01:23:44.796594 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 499/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:44 2022] GET /compute/v2.1/servers/49aad030-b12c-409b-b5da-ba6eb7779f32 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:23:45.058052 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:45.058795 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:45.066052 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:45.066501 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:45.067288 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:45.067713 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:45.087337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:45.207568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:45.215532 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6a6f4438-493d-4fb8-a745-380a4e8e9582 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1368 microversion: 2.1 time: 0.161512 Jul 28 01:23:45.216098 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 527/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:45 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:46.120729 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-894b076d-3655-4ca5-80a8-e9a2d6927cdf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] Calling method '.version_select at 0x7ff71c659dc0>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:46.143656 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-894b076d-3655-4ca5-80a8-e9a2d6927cdf tempest-TestVolumeBootPattern-455249764 tempest-TestVolumeBootPattern-455249764-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-388651129" status: 202 len: 0 microversion: 2.1 time: 0.026783 Jul 28 01:23:46.144345 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 500/1027] 10.222.0.17 () {58 vars in 1260 bytes} [Thu Jul 28 01:23:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-388651129 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:23:46.237114 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:46.237735 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:46.244393 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:46.245144 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:46.246119 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:46.246746 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:46.459096 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:46.467413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b9106d79-d25b-4cef-8e56-b517db1150ef tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1368 microversion: 2.1 time: 0.234661 Jul 28 01:23:46.468253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 528/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:46 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:47.489770 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:47.490359 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:47.497294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:47.497702 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:47.498804 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:47.499165 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:47.719646 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:47.727579 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-82abe6f2-6066-47cc-a60b-9400065a4d7d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1368 microversion: 2.1 time: 0.242198 Jul 28 01:23:47.728164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 501/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:47 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:48.551514 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-ef41688d-ebcb-46ee-a9b8-1ee5c6d6d459 req-9649036a-ed80-413f-b0b6-5c669e3ed744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ac698d-b3fd-49fa-b040-c9521c87932a", "name": "network-vif-plugged", "status": "completed", "tag": "1c124828-ba63-4126-8155-ff63fb6ffd96"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:48.559695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:48.567305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ef41688d-ebcb-46ee-a9b8-1ee5c6d6d459 req-9649036a-ed80-413f-b0b6-5c669e3ed744 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:48.567814 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ef41688d-ebcb-46ee-a9b8-1ee5c6d6d459 req-9649036a-ed80-413f-b0b6-5c669e3ed744 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:48.582699 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-ef41688d-ebcb-46ee-a9b8-1ee5c6d6d459 req-9649036a-ed80-413f-b0b6-5c669e3ed744 service nova] Creating event network-vif-plugged:1c124828-ba63-4126-8155-ff63fb6ffd96 for instance f8ac698d-b3fd-49fa-b040-c9521c87932a on hv-cinder-81558 Jul 28 01:23:48.589400 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-ef41688d-ebcb-46ee-a9b8-1ee5c6d6d459 req-9649036a-ed80-413f-b0b6-5c669e3ed744 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041859 Jul 28 01:23:48.590621 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 529/1030] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:48.749911 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:48.750554 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:48.752604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:48.753272 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=6 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:23:48.760221 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:48.760673 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:48.761455 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:48.761894 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:49.068652 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:49.078124 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b5eca1ee-78c1-474c-9dce-b7e284149468 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1368 microversion: 2.1 time: 0.332365 Jul 28 01:23:49.078714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 502/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:48 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:23:50.100688 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:50.101373 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:50.108247 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:50.108952 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:50.109738 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:50.110149 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:50.253253 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:23:50.261444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5a243705-ade8-4b10-a91c-7c1ec3c69a39 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1557 microversion: 2.1 time: 0.165143 Jul 28 01:23:50.262035 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 530/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:23:50 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:23:50.282759 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-05982797-bcb1-477a-bbb6-c9269e22ec20 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:23:50.283385 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-05982797-bcb1-477a-bbb6-c9269e22ec20 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:23:50.289893 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05982797-bcb1-477a-bbb6-c9269e22ec20 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:50.290332 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05982797-bcb1-477a-bbb6-c9269e22ec20 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:50.291164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05982797-bcb1-477a-bbb6-c9269e22ec20 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:50.291576 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05982797-bcb1-477a-bbb6-c9269e22ec20 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:50.384955 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-05982797-bcb1-477a-bbb6-c9269e22ec20 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106098 Jul 28 01:23:50.385566 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 503/1033] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:23:50 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:23:51.377847 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-7ae1ac54-b92d-4130-844f-c50c8b8e6bc7 req-546c0733-451b-47f1-afef-08c33949952d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ac698d-b3fd-49fa-b040-c9521c87932a", "tag": "1c124828-ba63-4126-8155-ff63fb6ffd96"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:23:51.388987 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-7ae1ac54-b92d-4130-844f-c50c8b8e6bc7 req-546c0733-451b-47f1-afef-08c33949952d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:23:51.389523 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-7ae1ac54-b92d-4130-844f-c50c8b8e6bc7 req-546c0733-451b-47f1-afef-08c33949952d service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:23:51.401464 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-7ae1ac54-b92d-4130-844f-c50c8b8e6bc7 req-546c0733-451b-47f1-afef-08c33949952d service nova] Creating event network-changed:1c124828-ba63-4126-8155-ff63fb6ffd96 for instance f8ac698d-b3fd-49fa-b040-c9521c87932a on hv-cinder-81558 Jul 28 01:23:51.406725 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-7ae1ac54-b92d-4130-844f-c50c8b8e6bc7 req-546c0733-451b-47f1-afef-08c33949952d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032840 Jul 28 01:23:51.407920 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 531/1034] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:22.903319 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:22.904588 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:22.910953 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0d19f19b-5f9b-4a5a-854a-68d8994a3166 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:22.911770 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0d19f19b-5f9b-4a5a-854a-68d8994a3166 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:22.923796 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0d19f19b-5f9b-4a5a-854a-68d8994a3166 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:22.924553 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0d19f19b-5f9b-4a5a-854a-68d8994a3166 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:22.925741 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0d19f19b-5f9b-4a5a-854a-68d8994a3166 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:22.926180 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0d19f19b-5f9b-4a5a-854a-68d8994a3166 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:22.951445 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0d19f19b-5f9b-4a5a-854a-68d8994a3166 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/ips" status: 200 len: 147 microversion: 2.1 time: 0.050871 Jul 28 01:24:22.952012 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 504/1035] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:24:22 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/ips => generated 147 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:24.293522 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1307cb03-312b-4428-8f51-cb81ac1e776d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:24.296061 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1307cb03-312b-4428-8f51-cb81ac1e776d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:24.298440 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:24.299109 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=18 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:24.304957 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1307cb03-312b-4428-8f51-cb81ac1e776d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:24.305399 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1307cb03-312b-4428-8f51-cb81ac1e776d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:24.306158 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1307cb03-312b-4428-8f51-cb81ac1e776d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:24.306586 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1307cb03-312b-4428-8f51-cb81ac1e776d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:24.572384 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1307cb03-312b-4428-8f51-cb81ac1e776d tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282683 Jul 28 01:24:24.576531 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 532/1036] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:24:24 2022] POST /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:31.091510 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:31.093866 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:31.100661 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:31.101111 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:31.101875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:31.102305 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:31.182714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Invalid volume: volume f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d is already attached to instances: f8ac698d-b3fd-49fa-b040-c9521c87932a Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: POST /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments HTTP/1.1 Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 74 Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:24:31.184395 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {"volumeAttachment": {"volumeId": "f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d"}} Jul 28 01:24:31.185993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Invalid volume: volume f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d is already attached to instances: f8ac698d-b3fd-49fa-b040-c9521c87932a Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'server_id': 'f8ac698d-b3fd-49fa-b040-c9521c87932a', 'body': {'volumeAttachment': {'volumeId': 'f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d'}}} Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d is already attached to instances: f8ac698d-b3fd-49fa-b040-c9521c87932a Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:24:31.186881 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d is already attached to instances: f8ac698d-b3fd-49fa-b040-c9521c87932a Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:24:31.188374 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d is already attached to instances: f8ac698d-b3fd-49fa-b040-c9521c87932a Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 400 to user: Invalid volume: volume f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d is already attached to instances: f8ac698d-b3fd-49fa-b040-c9521c87932a {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0c843f67-fd5e-424a-b562-e374a6767f26 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098333 Jul 28 01:24:31.190004 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 505/1037] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:24:31 2022] POST /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 01:24:31.252211 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:31.252749 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:31.259651 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:31.260097 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:31.260865 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:31.261289 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:31.342589 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lazy-loading 'services' on Instance uuid f8ac698d-b3fd-49fa-b040-c9521c87932a {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:24:31.417174 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0435928d-00b6-415e-8c7e-83d109ccec3a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments/f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d" status: 202 len: 0 microversion: 2.1 time: 0.169641 Jul 28 01:24:31.417772 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 533/1038] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:24:31 2022] DELETE /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments/f9ed2c2a-202f-45fe-b5e4-2cdf0220a40d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:24:31.426421 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-c535a171-4d1e-4578-a9a1-e6a8eb6cbed4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:31.428672 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-c535a171-4d1e-4578-a9a1-e6a8eb6cbed4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:31.436003 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c535a171-4d1e-4578-a9a1-e6a8eb6cbed4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:31.436492 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c535a171-4d1e-4578-a9a1-e6a8eb6cbed4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:31.437248 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c535a171-4d1e-4578-a9a1-e6a8eb6cbed4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:31.437747 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-c535a171-4d1e-4578-a9a1-e6a8eb6cbed4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:31.468665 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-c535a171-4d1e-4578-a9a1-e6a8eb6cbed4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046338 Jul 28 01:24:31.469260 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 506/1039] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:24:31 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:32.482767 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-198b0fec-f02c-460e-8f5e-0d5803e7cf95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:32.485363 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-198b0fec-f02c-460e-8f5e-0d5803e7cf95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:32.492190 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-198b0fec-f02c-460e-8f5e-0d5803e7cf95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:32.492785 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-198b0fec-f02c-460e-8f5e-0d5803e7cf95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:32.493599 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-198b0fec-f02c-460e-8f5e-0d5803e7cf95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:32.494102 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-198b0fec-f02c-460e-8f5e-0d5803e7cf95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:32.524195 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-198b0fec-f02c-460e-8f5e-0d5803e7cf95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046432 Jul 28 01:24:32.524751 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 534/1040] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:24:32 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:24:32.587401 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:32.587985 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:32.595057 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:32.595510 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:32.596284 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:32.596721 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:32.621500 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:24:32.702441 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2a3db075-6a6e-4932-b354-dcfe34fe193e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 204 len: 0 microversion: 2.1 time: 0.118528 Jul 28 01:24:32.703161 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 507/1041] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:24:32 2022] DELETE /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:24:32.712219 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:32.713110 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:32.718936 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:32.719387 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:32.720139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:32.720568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:32.861323 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:32.870798 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2fde95f6-5e93-4f9b-a974-19da01e4998a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1680 microversion: 2.1 time: 0.163244 Jul 28 01:24:32.871401 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 535/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:32 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:33.901081 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:33.902264 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:33.912517 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:33.913038 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:33.914048 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:33.914794 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:34.060045 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:34.068104 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-fa56674b-efba-41aa-9a05-cc7fa94d83f4 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1680 microversion: 2.1 time: 0.174188 Jul 28 01:24:34.068678 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 508/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:33 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:35.090500 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:35.092310 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:35.102796 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:35.103555 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:35.104675 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:35.105325 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:35.304911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-a91f8ca5-8914-4dfd-ae1a-1cfa5f0cddb7 req-a93fb95b-a2d6-48f8-a979-2bd8274b0ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ac698d-b3fd-49fa-b040-c9521c87932a", "name": "network-vif-deleted", "tag": "1c124828-ba63-4126-8155-ff63fb6ffd96"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:35.316097 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a91f8ca5-8914-4dfd-ae1a-1cfa5f0cddb7 req-a93fb95b-a2d6-48f8-a979-2bd8274b0ddc service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:35.317776 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a91f8ca5-8914-4dfd-ae1a-1cfa5f0cddb7 req-a93fb95b-a2d6-48f8-a979-2bd8274b0ddc service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:35.336747 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-a91f8ca5-8914-4dfd-ae1a-1cfa5f0cddb7 req-a93fb95b-a2d6-48f8-a979-2bd8274b0ddc service nova] Creating event network-vif-deleted:1c124828-ba63-4126-8155-ff63fb6ffd96 for instance f8ac698d-b3fd-49fa-b040-c9521c87932a on hv-cinder-81558 Jul 28 01:24:35.341976 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-a91f8ca5-8914-4dfd-ae1a-1cfa5f0cddb7 req-a93fb95b-a2d6-48f8-a979-2bd8274b0ddc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292130 Jul 28 01:24:35.342766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 536/1044] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 01:24:35.493101 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:35.501744 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d3c2b8e9-0c49-4492-8cc8-4c56c5a17ce2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 200 len: 1327 microversion: 2.1 time: 0.415941 Jul 28 01:24:35.503736 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 509/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:35 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 1327 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:24:36.529407 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:36.530564 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:36.541393 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:36.542134 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:36.543471 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:36.544245 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:36.560533 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a HTTP/1.1 Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:24:36.562143 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:24:36.563681 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'f8ac698d-b3fd-49fa-b040-c9521c87932a'} Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:24:36.564530 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:24:36.566189 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:24:36.568137 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:24:36.568137 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4f24fc37-4e7c-48d5-a64d-2bd7d698cd6e tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 404 len: 111 microversion: 2.1 time: 0.042000 Jul 28 01:24:36.568137 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 537/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:36 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:24:36.572841 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-55f15925-37bc-4abf-8a21-f4bf89e7cf22 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '.version_select at 0x7ff71c6afdc0>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:36.594408 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-55f15925-37bc-4abf-8a21-f4bf89e7cf22 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229861701" status: 202 len: 0 microversion: 2.1 time: 0.025408 Jul 28 01:24:36.595035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 510/1047] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Jul 28 01:24:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229861701 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:24:37.247309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cac438f0-a44b-495b-ab66-0c9cbeb0110a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: .version_select at 0x7ff71c5f3310>, body: {"keypair": {"name": "tempest-keypair-1282993785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME1j1mTi2h8pqCwL6QC2e8UcRcHIR69ZAtjsri740TptZfmV3qwzX+uxCdJTTKv6uc9pSq5+GrZUwUbY/hPiqzAsvjfPl5q7gUu9F5gnF16YO9Q1AGQ5upyj7hUqwMA6A=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:37.263236 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-cac438f0-a44b-495b-ab66-0c9cbeb0110a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:24:37.267207 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-cac438f0-a44b-495b-ab66-0c9cbeb0110a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:24:37.291769 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cac438f0-a44b-495b-ab66-0c9cbeb0110a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048320 Jul 28 01:24:37.292343 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 538/1048] 10.222.0.17 () {60 vars in 1159 bytes} [Thu Jul 28 01:24:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:38.865111 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1535717302", "imageRef": "c7b26ec0-607b-4d5c-bf46-6c9c7032f02e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bac661c0-9620-4ebf-b1dc-5201ea1d9315"}], "security_groups": [{"name": "tempest-securitygroup--1900542755"}], "key_name": "tempest-keypair-1282993785", "user_data": "}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:38.972890 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.network.neutron [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] validate_networks() for [('bac661c0-9620-4ebf-b1dc-5201ea1d9315', None, None, None, None, None)] {{(pid=117960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 01:24:39.495557 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 01:24:39.495985 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image limits 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 01:24:39.496465 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Flavor pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 01:24:39.496878 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Image pref 0:0:0 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 01:24:39.497288 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.virt.hardware [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 01:24:39.506934 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:39.507388 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:39.508202 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:39.508639 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:39.525302 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 01:24:39.530713 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.quota [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Getting quotas for user 6b069c6a7f1e4241816e5c91874cbcd6 and project adb91176f5f74f1199b2fc27c248cecd. Resources: {'ram', 'cores', 'instances'} {{(pid=117960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 01:24:39.545613 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Going to run 1 instances... {{(pid=117960) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 01:24:39.547947 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7b26ec0-607b-4d5c-bf46-6c9c7032f02e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 01:24:39.596577 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ca571155-8727-4d1b-98f4-26dbf12afd5b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.738023 Jul 28 01:24:39.598215 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 511/1049] 10.222.0.17 () {60 vars in 1147 bytes} [Thu Jul 28 01:24:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 01:24:39.609295 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5bb8f315-937d-43aa-867f-2a7b88be8db3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:39.609871 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5bb8f315-937d-43aa-867f-2a7b88be8db3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:39.664766 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5bb8f315-937d-43aa-867f-2a7b88be8db3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:39.672154 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5bb8f315-937d-43aa-867f-2a7b88be8db3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1242 microversion: 2.1 time: 0.067301 Jul 28 01:24:39.672717 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 539/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:39 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:40.694029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0f3ee105-ac98-4da3-b956-2a867c1f97b3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:40.694680 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0f3ee105-ac98-4da3-b956-2a867c1f97b3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:40.748877 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0f3ee105-ac98-4da3-b956-2a867c1f97b3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:40.756317 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0f3ee105-ac98-4da3-b956-2a867c1f97b3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1242 microversion: 2.1 time: 0.067107 Jul 28 01:24:40.756857 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 512/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:40 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:41.777328 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bc8f2dce-0b94-42c4-8b9d-a17bac8e0750 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:41.777967 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bc8f2dce-0b94-42c4-8b9d-a17bac8e0750 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:41.838309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bc8f2dce-0b94-42c4-8b9d-a17bac8e0750 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:41.846021 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bc8f2dce-0b94-42c4-8b9d-a17bac8e0750 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1242 microversion: 2.1 time: 0.072465 Jul 28 01:24:41.846657 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 540/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:41 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:42.869885 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b025e3a9-991b-4b6e-b4e0-ba27f312da87 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:42.874112 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b025e3a9-991b-4b6e-b4e0-ba27f312da87 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:42.929099 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b025e3a9-991b-4b6e-b4e0-ba27f312da87 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:42.935935 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b025e3a9-991b-4b6e-b4e0-ba27f312da87 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1242 microversion: 2.1 time: 0.071060 Jul 28 01:24:42.936497 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 513/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:42 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:43.960980 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:43.961749 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:43.971852 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:43.972454 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:43.973473 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:43.974055 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:44.038040 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:44.046223 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-054596e9-d78a-46f2-bf6f-bdcd9f779f71 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1246 microversion: 2.1 time: 0.091931 Jul 28 01:24:44.046775 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 541/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:43 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:45.066679 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:45.067322 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:45.074541 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:45.075040 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:45.075855 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:45.076392 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:45.175427 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:45.183460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2dcd103b-0a0f-4999-ad7d-2e01fe5cee8b tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1300 microversion: 2.1 time: 0.120759 Jul 28 01:24:45.183996 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 514/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:45 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:46.034676 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-e3eedfec-2554-47ce-b574-ec46e943a12f req-c19cb722-e514-4f7b-ad9d-76a150016479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48d8b19-cc65-46a9-a5af-3ed43d5112b8", "tag": "ab826f4b-ea12-4f41-8f27-c2c7c9639e90"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:46.059342 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e3eedfec-2554-47ce-b574-ec46e943a12f req-c19cb722-e514-4f7b-ad9d-76a150016479 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:46.059730 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e3eedfec-2554-47ce-b574-ec46e943a12f req-c19cb722-e514-4f7b-ad9d-76a150016479 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:46.072929 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-e3eedfec-2554-47ce-b574-ec46e943a12f req-c19cb722-e514-4f7b-ad9d-76a150016479 service nova] Creating event network-changed:ab826f4b-ea12-4f41-8f27-c2c7c9639e90 for instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 on hv-cinder-81558 Jul 28 01:24:46.078194 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-e3eedfec-2554-47ce-b574-ec46e943a12f req-c19cb722-e514-4f7b-ad9d-76a150016479 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051398 Jul 28 01:24:46.079135 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 542/1056] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:46.204874 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:46.205601 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:46.212560 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:46.213012 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:46.213801 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:46.214373 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:46.415816 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:46.424260 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-01175cc2-4593-45aa-ba74-5e435d6ccb16 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1368 microversion: 2.1 time: 0.223317 Jul 28 01:24:46.424808 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 515/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:46 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:47.449674 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:47.450454 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:47.457092 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:47.457542 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:47.458309 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:47.458738 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:47.669245 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:47.678626 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-771d2f4e-01e9-45f9-a1d1-234e28ccb8a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1368 microversion: 2.1 time: 0.233915 Jul 28 01:24:47.679338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 543/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:47 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:48.700066 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:48.700715 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:48.707178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:48.707628 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:48.708405 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:48.708835 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:48.841655 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:48.850718 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-0a03f1c7-a6d3-4440-b68e-70551ed3cbdd tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1368 microversion: 2.1 time: 0.154882 Jul 28 01:24:48.851586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 516/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:48 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:49.883235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:49.884238 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:49.895248 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:49.896005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:49.897267 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:49.897983 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:50.029921 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:50.037914 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a2e8ddd9-1e76-4cfb-88b6-0d53a45215af tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1368 microversion: 2.1 time: 0.161705 Jul 28 01:24:50.038482 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 544/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:49 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:50.435942 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=2 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:50.498319 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-d4effe03-b4dd-4b0f-839d-64d71f9479e4 req-c4bec65f-1e7e-45b5-ba16-804c261eb946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48d8b19-cc65-46a9-a5af-3ed43d5112b8", "name": "network-vif-plugged", "status": "completed", "tag": "ab826f4b-ea12-4f41-8f27-c2c7c9639e90"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:50.508245 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d4effe03-b4dd-4b0f-839d-64d71f9479e4 req-c4bec65f-1e7e-45b5-ba16-804c261eb946 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:50.508688 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-d4effe03-b4dd-4b0f-839d-64d71f9479e4 req-c4bec65f-1e7e-45b5-ba16-804c261eb946 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:50.519950 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-d4effe03-b4dd-4b0f-839d-64d71f9479e4 req-c4bec65f-1e7e-45b5-ba16-804c261eb946 service nova] Creating event network-vif-plugged:ab826f4b-ea12-4f41-8f27-c2c7c9639e90 for instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 on hv-cinder-81558 Jul 28 01:24:50.525044 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-d4effe03-b4dd-4b0f-839d-64d71f9479e4 req-c4bec65f-1e7e-45b5-ba16-804c261eb946 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093609 Jul 28 01:24:50.525607 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 517/1061] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:51.066389 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:51.067374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:51.078502 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:51.079307 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:51.080583 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:51.081311 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:51.215699 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:51.223637 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8b49fe2-d75d-45e3-89b0-30bd4c3f8e34 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1368 microversion: 2.1 time: 0.163776 Jul 28 01:24:51.224210 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 545/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:51 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:52.250686 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:52.251891 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:52.262376 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:52.262820 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:52.263615 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:52.264046 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:52.399918 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:24:52.411320 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ecea070c-e50d-4fcf-baac-6c1c00bbf44c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1558 microversion: 2.1 time: 0.168387 Jul 28 01:24:52.412136 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 518/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:24:52 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:24:52.437005 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85f565d4-8249-463e-b50b-760c94ee03a2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:24:52.437502 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-85f565d4-8249-463e-b50b-760c94ee03a2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:24:52.440296 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=8 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:52.447150 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f565d4-8249-463e-b50b-760c94ee03a2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:52.447597 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f565d4-8249-463e-b50b-760c94ee03a2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:52.448363 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f565d4-8249-463e-b50b-760c94ee03a2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:52.448893 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f565d4-8249-463e-b50b-760c94ee03a2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:52.529342 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85f565d4-8249-463e-b50b-760c94ee03a2 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098662 Jul 28 01:24:52.530175 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 546/1064] 10.222.0.17 () {58 vars in 1275 bytes} [Thu Jul 28 01:24:52 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:24:53.734735 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [req-b153aa98-e355-4ef1-86be-6067d1025cbe req-08c1f642-f712-4d8a-876f-939dc203c4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48d8b19-cc65-46a9-a5af-3ed43d5112b8", "tag": "ab826f4b-ea12-4f41-8f27-c2c7c9639e90"}]} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:24:53.739742 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell0:SELECT=10 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:53.740902 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:53.746914 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-b153aa98-e355-4ef1-86be-6067d1025cbe req-08c1f642-f712-4d8a-876f-939dc203c4a9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:24:53.747353 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [req-b153aa98-e355-4ef1-86be-6067d1025cbe req-08c1f642-f712-4d8a-876f-939dc203c4a9 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:24:53.751440 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG dbcounter [-] [117960] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:24:53.760134 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.compute.server_external_events [req-b153aa98-e355-4ef1-86be-6067d1025cbe req-08c1f642-f712-4d8a-876f-939dc203c4a9 service nova] Creating event network-changed:ab826f4b-ea12-4f41-8f27-c2c7c9639e90 for instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 on hv-cinder-81558 Jul 28 01:24:53.765445 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [req-b153aa98-e355-4ef1-86be-6067d1025cbe req-08c1f642-f712-4d8a-876f-939dc203c4a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034395 Jul 28 01:24:53.766080 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 519/1065] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:25:23.348265 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:25:23.349689 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 01:25:23.354228 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ee6be1db-8f5e-4297-b8bc-9a80949fe189 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:23.354728 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ee6be1db-8f5e-4297-b8bc-9a80949fe189 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:23.363368 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee6be1db-8f5e-4297-b8bc-9a80949fe189 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:23.363817 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee6be1db-8f5e-4297-b8bc-9a80949fe189 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:23.364596 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee6be1db-8f5e-4297-b8bc-9a80949fe189 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:23.365058 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee6be1db-8f5e-4297-b8bc-9a80949fe189 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:23.394242 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ee6be1db-8f5e-4297-b8bc-9a80949fe189 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.048512 Jul 28 01:25:23.394821 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 547/1066] 10.222.0.17 () {58 vars in 1248 bytes} [Thu Jul 28 01:25:23 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:25:24.755556 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-d476e0a2-ae7e-48d3-845a-6e0e4056b724 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d6dbdc6-c61e-48f0-8a20-236f65b62f37"}} {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:25:24.757939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-d476e0a2-ae7e-48d3-845a-6e0e4056b724 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:24.766263 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d476e0a2-ae7e-48d3-845a-6e0e4056b724 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:24.766718 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d476e0a2-ae7e-48d3-845a-6e0e4056b724 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:24.767490 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d476e0a2-ae7e-48d3-845a-6e0e4056b724 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:24.767938 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-d476e0a2-ae7e-48d3-845a-6e0e4056b724 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:25.014178 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-d476e0a2-ae7e-48d3-845a-6e0e4056b724 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "POST /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264595 Jul 28 01:25:25.014815 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 520/1067] 10.222.0.17 () {60 vars in 1323 bytes} [Thu Jul 28 01:25:24 2022] POST /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:25:31.650783 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:31.651413 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:31.658130 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:31.658575 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:31.659365 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:31.659802 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:31.740122 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lazy-loading 'services' on Instance uuid d48d8b19-cc65-46a9-a5af-3ed43d5112b8 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:25:31.825872 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-825fc3f1-7008-45ca-9651-9ba990a46639 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments/3d6dbdc6-c61e-48f0-8a20-236f65b62f37" status: 202 len: 0 microversion: 2.1 time: 0.178826 Jul 28 01:25:31.826455 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 548/1068] 10.222.0.17 () {58 vars in 1416 bytes} [Thu Jul 28 01:25:31 2022] DELETE /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments/3d6dbdc6-c61e-48f0-8a20-236f65b62f37 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:25:31.836266 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-ed69c97f-ca51-4150-881c-66145027ecd5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:31.838569 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-ed69c97f-ca51-4150-881c-66145027ecd5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:31.845600 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed69c97f-ca51-4150-881c-66145027ecd5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:31.846035 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed69c97f-ca51-4150-881c-66145027ecd5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:31.846817 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed69c97f-ca51-4150-881c-66145027ecd5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:31.847282 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-ed69c97f-ca51-4150-881c-66145027ecd5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:31.876843 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-ed69c97f-ca51-4150-881c-66145027ecd5 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Jul 28 01:25:31.877396 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 521/1069] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:25:31 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:25:32.895961 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1b33fa7c-ec8c-4ed1-94a8-df44e0bfa94c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:32.899685 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1b33fa7c-ec8c-4ed1-94a8-df44e0bfa94c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:32.906775 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b33fa7c-ec8c-4ed1-94a8-df44e0bfa94c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:32.907250 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b33fa7c-ec8c-4ed1-94a8-df44e0bfa94c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:32.908015 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b33fa7c-ec8c-4ed1-94a8-df44e0bfa94c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:32.908444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b33fa7c-ec8c-4ed1-94a8-df44e0bfa94c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:32.937218 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1b33fa7c-ec8c-4ed1-94a8-df44e0bfa94c tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049553 Jul 28 01:25:32.937756 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 549/1070] 10.222.0.17 () {58 vars in 1302 bytes} [Thu Jul 28 01:25:32 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 01:25:32.999811 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:33.000336 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:33.007656 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:33.008110 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:33.008875 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:33.009307 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:33.034861 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Going to try to terminate instance {{(pid=117960) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 01:25:33.114348 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-49bc2d2e-a0b4-4b13-bdf7-91965abb7d95 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 204 len: 0 microversion: 2.1 time: 0.118076 Jul 28 01:25:33.115022 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 522/1071] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:25:32 2022] DELETE /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 01:25:33.123568 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:33.124170 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:33.130624 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:33.131090 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:33.131838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:33.132262 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:33.264205 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:25:33.275886 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f31175c7-6229-41a8-b5bb-eae4a6639ae3 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1682 microversion: 2.1 time: 0.155943 Jul 28 01:25:33.276578 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 550/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:33 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:25:34.308203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:34.309397 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:34.320340 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:34.321063 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:34.322483 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:34.323847 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:34.481689 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:25:34.489429 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b24ffe5c-a081-4360-98c6-2985c5802ebf tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1682 microversion: 2.1 time: 0.188635 Jul 28 01:25:34.489965 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 523/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:34 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 01:25:35.425390 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-c1b7aee3-09d9-4346-abc2-99da6478b8a4 req-1aba73dd-d0cf-462d-ad46-fe01e71d8393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48d8b19-cc65-46a9-a5af-3ed43d5112b8", "name": "network-vif-deleted", "tag": "ab826f4b-ea12-4f41-8f27-c2c7c9639e90"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 01:25:35.436456 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-c1b7aee3-09d9-4346-abc2-99da6478b8a4 req-1aba73dd-d0cf-462d-ad46-fe01e71d8393 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:35.437216 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-c1b7aee3-09d9-4346-abc2-99da6478b8a4 req-1aba73dd-d0cf-462d-ad46-fe01e71d8393 service nova] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:35.451831 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-c1b7aee3-09d9-4346-abc2-99da6478b8a4 req-1aba73dd-d0cf-462d-ad46-fe01e71d8393 service nova] Creating event network-vif-deleted:ab826f4b-ea12-4f41-8f27-c2c7c9639e90 for instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 on hv-cinder-81558 Jul 28 01:25:35.460454 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-c1b7aee3-09d9-4346-abc2-99da6478b8a4 req-1aba73dd-d0cf-462d-ad46-fe01e71d8393 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Jul 28 01:25:35.461227 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 551/1074] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jul 28 01:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 01:25:35.514334 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:35.516287 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:35.528350 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:35.529011 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:35.529997 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:35.531086 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:35.578137 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:35.578593 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:35.579123 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.objects.instance [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lazy-loading 'fault' on Instance uuid d48d8b19-cc65-46a9-a5af-3ed43d5112b8 {{(pid=117960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 01:25:35.623204 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.policy [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b069c6a7f1e4241816e5c91874cbcd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb91176f5f74f1199b2fc27c248cecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117960) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 01:25:35.632294 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-05ce2fd5-106f-4c60-a199-c96f821249f6 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 200 len: 1332 microversion: 2.1 time: 0.124124 Jul 28 01:25:35.635354 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 524/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:35 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 01:25:36.656394 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:36.657100 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:36.664350 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:36.664800 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:36.665569 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:36.666002 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:36.683500 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 HTTP/1.1 Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:25:36.685101 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:36.686777 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'd48d8b19-cc65-46a9-a5af-3ed43d5112b8'} Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:36.687755 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:36.689321 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:36.690695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:36.690695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6447403c-2b0c-499f-bc9f-9f05f84b4229 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 404 len: 111 microversion: 2.1 time: 0.035014 Jul 28 01:25:36.690695 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 552/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:36 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:36.695597 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-2aaf38f1-bc7a-45ff-931f-e87c3cb9f034 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '.version_select at 0x7ff71c59cc10>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:36.717161 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-2aaf38f1-bc7a-45ff-931f-e87c3cb9f034 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282993785" status: 202 len: 0 microversion: 2.1 time: 0.025416 Jul 28 01:25:36.717720 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 525/1077] 10.222.0.17 () {58 vars in 1221 bytes} [Thu Jul 28 01:25:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282993785 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 01:25:38.489856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:38.490338 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:38.497025 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:38.497462 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:38.498212 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:38.498640 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:38.512337 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 HTTP/1.1 Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:25:38.513838 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.515388 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'd48d8b19-cc65-46a9-a5af-3ed43d5112b8'} Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:38.518139 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.519576 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.521031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:38.521031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-12b8c7c3-3887-481c-bb04-ce6ca5cf868a tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 404 len: 111 microversion: 2.1 time: 0.029270 Jul 28 01:25:38.521031 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 553/1078] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:25:38 2022] DELETE /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:38.526056 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:38.526703 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d48d8b19-cc65-46a9-a5af-3ed43d5112b8] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:38.536525 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:38.537172 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:38.538357 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:38.539026 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:38.553717 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 HTTP/1.1 Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:25:38.555383 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.556939 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'd48d8b19-cc65-46a9-a5af-3ed43d5112b8'} Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:38.557840 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. Jul 28 01:25:38.559355 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:38.560690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance d48d8b19-cc65-46a9-a5af-3ed43d5112b8 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:38.560690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-cecc9852-0188-447e-9d30-bb83f41f7e46 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8" status: 404 len: 111 microversion: 2.1 time: 0.036890 Jul 28 01:25:38.560690 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 526/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:38 2022] GET /compute/v2.1/servers/d48d8b19-cc65-46a9-a5af-3ed43d5112b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:39.706816 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:39.707364 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:39.714209 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.714703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.715512 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.715949 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.730427 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a HTTP/1.1 Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:25:39.731944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.733537 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'f8ac698d-b3fd-49fa-b040-c9521c87932a'} Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:39.734526 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.735887 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.738081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:39.738081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d03c31e1-5b33-46e1-99e4-cabd2adc63be tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 404 len: 111 microversion: 2.1 time: 0.030420 Jul 28 01:25:39.738081 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 554/1080] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:25:39 2022] DELETE /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:39.741890 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:39.742512 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: f8ac698d-b3fd-49fa-b040-c9521c87932a] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:39.749718 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.750164 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.750975 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.751419 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.765084 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a HTTP/1.1 Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:25:39.766584 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.768163 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'f8ac698d-b3fd-49fa-b040-c9521c87932a'} Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:39.769214 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. Jul 28 01:25:39.770674 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.772435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance f8ac698d-b3fd-49fa-b040-c9521c87932a could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:39.772435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-b35c244d-66ca-4e0a-8367-abbd4bbc1370 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a" status: 404 len: 111 microversion: 2.1 time: 0.029999 Jul 28 01:25:39.772435 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 527/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:39 2022] GET /compute/v2.1/servers/f8ac698d-b3fd-49fa-b040-c9521c87932a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:39.779121 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:39.779881 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:39.789703 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.790432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.791305 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.791971 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.805644 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 HTTP/1.1 Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:25:39.807235 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.808839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': '0f1d5ccc-bac3-414d-9fdc-75722fb41926'} Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:39.809911 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.811432 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.813053 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:39.813053 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0cc7d9fa-623b-415a-b26a-557d84d70e97 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 404 len: 111 microversion: 2.1 time: 0.035907 Jul 28 01:25:39.813053 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 555/1082] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:25:39 2022] DELETE /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 01:25:39.817352 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:39.818014 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: 0f1d5ccc-bac3-414d-9fdc-75722fb41926] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:39.824306 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.824757 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.825525 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:39.825956 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:39.839460 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 HTTP/1.1 Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:25:39.840983 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.842714 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': '0f1d5ccc-bac3-414d-9fdc-75722fb41926'} Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:39.843774 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. Jul 28 01:25:39.844993 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:39.846203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance 0f1d5ccc-bac3-414d-9fdc-75722fb41926 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:39.846203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-8d486f47-bccc-419b-90af-2cbfcf1cb131 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926" status: 404 len: 111 microversion: 2.1 time: 0.029145 Jul 28 01:25:39.846203 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 528/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:39 2022] GET /compute/v2.1/servers/0f1d5ccc-bac3-414d-9fdc-75722fb41926 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:40.985815 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:40.986343 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:40.993162 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:40.993607 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:40.994374 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:40.994808 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:41.008839 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 HTTP/1.1 Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Connection: close Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Host: 10.222.0.17 Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 28 01:25:41.010360 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: method: > Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: exception: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.011856 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: action_args: {'id': 'd5671e0a-fdd0-4692-93aa-4ff5ef293562'} Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:41.014444 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.015873 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.017125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:41.017125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6f8a22a5-f266-4db8-baf9-73bdbd0815a1 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 404 len: 111 microversion: 2.1 time: 0.029900 Jul 28 01:25:41.017125 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 556/1084] 10.222.0.17 () {58 vars in 1239 bytes} [Thu Jul 28 01:25:40 2022] DELETE /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:41.020546 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Calling method '>' {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 01:25:41.021158 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.compute.api [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] [instance: d5671e0a-fdd0-4692-93aa-4ff5ef293562] Fetching instance by UUID {{(pid=117960) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 01:25:41.028162 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:41.028611 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:41.029378 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 01:25:41.029810 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG oslo_concurrency.lockutils [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Lock "7726ad62-7e36-457c-b9d8-9bde6568cf65" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 01:25:41.043510 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.wsgi [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] HTTP exception thrown: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Request method failure captured: Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: request: GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 HTTP/1.1 Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept: application/json Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Accept-Encoding: identity Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Connection: close Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Length: 0 Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Content-Type: application/json Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Host: 10.222.0.17 Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Openstack-System-Scope: None Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: User-Agent: python-urllib3/1.26.10 Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Auth-Token: gAAAAABi4eSWOOJf1LnphJ0ZiY-bpazj3aDMycqPWxw-xpQuSKTnIig_3AHiedyGLT7QSMvU4Wgbb10f2cl24vjCFa7ULwQA3WXAZeeE0ee_gL4HeVUkw5oabta0Lm5OGxpVt7u-MHkw-fBgYD-orANnu7Fp8N5cjgjZrMIlU8W_2JQaYB5WZB0 Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Id: None Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Domain-Name: None Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Identity-Status: Confirmed Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Is-Admin-Project: True Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Id: default Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Domain-Name: Default Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Project-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Role: reader,member Jul 28 01:25:41.045029 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Roles: reader,member Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_adb91176f5f74f1199b2fc27c248cecd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/adb91176f5f74f1199b2fc27c248cecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Id: adb91176f5f74f1199b2fc27c248cecd Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1663133396 Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Id: default Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Domain-Name: Default Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Id: 6b069c6a7f1e4241816e5c91874cbcd6 Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: X-User-Name: tempest-AttachVolumeNegativeTest-1663133396-project Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: method: > Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: exception: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.046604 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: action_args: {'id': 'd5671e0a-fdd0-4692-93aa-4ff5ef293562'} Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: {{(pid=117960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 01:25:41.047550 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. Jul 28 01:25:41.049041 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: ERROR nova.api.openstack.wsgi Jul 28 01:25:41.050452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: DEBUG nova.api.openstack.wsgi [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] Returning 404 to user: Instance d5671e0a-fdd0-4692-93aa-4ff5ef293562 could not be found. {{(pid=117960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 01:25:41.050452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO nova.api.openstack.requestlog [None req-f476373b-4568-4ca5-8019-e3b41fbd0806 tempest-AttachVolumeNegativeTest-1663133396 tempest-AttachVolumeNegativeTest-1663133396-project] 10.222.0.17 "GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562" status: 404 len: 111 microversion: 2.1 time: 0.029776 Jul 28 01:25:41.050452 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: [pid: 117960|app: 0|req: 529/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Thu Jul 28 01:25:41 2022] GET /compute/v2.1/servers/d5671e0a-fdd0-4692-93aa-4ff5ef293562 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 01:25:45.254437 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:25:45.254437 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Thu Jul 28 01:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:27:14.119225 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:27:14.120352 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Thu Jul 28 01:27:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:29:05.264944 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:29:05.266056 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Thu Jul 28 01:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:30:16.207586 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:30:16.208246 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Thu Jul 28 01:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:30:34.131327 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:30:34.132045 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Thu Jul 28 01:30:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:30:37.427109 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:30:37.428250 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Thu Jul 28 01:30:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:30:38.604751 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:30:38.605723 dv-cinder-815582-11-iscsi devstack@n-api.service[117960]: Thu Jul 28 01:30:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:30:57.134017 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:30:57.134724 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Thu Jul 28 01:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 01:32:25.278538 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 01:32:25.278538 dv-cinder-815582-11-iscsi devstack@n-api.service[117958]: Thu Jul 28 01:32:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!